-- Logs begin at Thu 2022-06-02 15:08:57 UTC, end at Thu 2022-06-02 16:58:18 UTC. -- Jun 02 15:57:22.392329 dv-cinder-797608-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 15:57:22.401625 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 15:57:22 2022] *** Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: nodename: dv-cinder-797608-27-iscsi Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: machine: x86_64 Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: clock source: unix Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: pcre jit disabled Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: detected number of CPU cores: 4 Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: current working directory: / Jun 02 15:57:22.403576 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: detected binary path: /usr/bin/uwsgi-core Jun 02 15:57:22.404253 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: your processes number limit is 47680 Jun 02 15:57:22.404253 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: your memory page size is 4096 bytes Jun 02 15:57:22.404253 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: detected max file descriptor number: 2048 Jun 02 15:57:22.404253 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: lock engine: pthread robust mutexes Jun 02 15:57:22.404253 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: thunder lock: enabled Jun 02 15:57:22.404253 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 15:57:22.404253 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 15:57:22.447704 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: Python main interpreter initialized at 0x5599b95449c0 Jun 02 15:57:22.447704 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: python threads support enabled Jun 02 15:57:22.447704 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: your server socket listen backlog is limited to 100 connections Jun 02 15:57:22.447704 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: your mercy for graceful operations on workers is 90 seconds Jun 02 15:57:22.448036 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 15:57:22.448036 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: *** Operational MODE: preforking *** Jun 02 15:57:22.448306 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: *** uWSGI is running in multiple interpreter mode *** Jun 02 15:57:22.448306 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: spawned uWSGI master process (pid: 103833) Jun 02 15:57:22.448489 dv-cinder-797608-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 15:57:22.453367 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: spawned uWSGI worker 1 (pid: 103834, cores: 1) Jun 02 15:57:22.453367 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: spawned uWSGI worker 2 (pid: 103835, cores: 1) Jun 02 15:57:22.453367 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 15:57:23.663665 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 15:57:23.675463 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 15:57:24.381925 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:57:24.381925 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: from cryptography.utils import int_from_bytes Jun 02 15:57:24.382295 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:57:24.382295 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: from cryptography.utils import int_from_bytes Jun 02 15:57:24.383791 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:57:24.383791 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: from cryptography.utils import int_from_bytes Jun 02 15:57:24.384131 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:57:24.384131 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: from cryptography.utils import int_from_bytes Jun 02 15:57:26.959004 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 15:57:26.959596 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 15:57:26.959929 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 15:57:26.960045 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 15:57:26.960401 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 15:57:26.960494 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 15:57:26.960578 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 15:57:26.960797 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 15:57:26.960906 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.961219 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.961318 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 15:57:26.961477 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 15:57:26.961564 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.961847 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.961951 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.962202 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.962306 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.962515 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.962614 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.962835 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.962929 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.963154 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.963240 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.963481 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.963574 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.963750 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.963843 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.964063 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.964201 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.964385 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-27-iscsi {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.964615 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.964737 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.964867 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.965037 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.965166 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.965365 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-27-iscsi {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.965494 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.965941 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.966089 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.966269 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.966391 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.966583 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.966671 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.966885 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.966970 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.967201 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.967377 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.967532 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.967815 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.967916 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.968119 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.968336 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.968446 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.968652 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.968756 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.968964 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.969063 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.969276 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.969371 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.969618 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.969710 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.969937 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.970033 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.970275 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.970370 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.970582 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.970682 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.970900 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.970992 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-27-iscsi {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.971230 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.971322 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.971542 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.971638 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.971878 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.971959 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-27-iscsi {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.972247 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.972344 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.972565 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.972661 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.972885 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.972983 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.973204 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.973303 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.973530 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.973638 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.973840 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.973943 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.974196 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.974294 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.974519 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.974615 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.975367 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.975512 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.975684 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.975771 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.976006 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.976092 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.976332 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.976427 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.976657 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.976743 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.976964 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.977050 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.977265 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.977361 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.977568 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.977654 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.977819 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.977907 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.978150 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.978255 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.978472 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.978564 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.978743 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.978831 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.979056 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.979143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.979337 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.979421 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.979588 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.979681 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.979904 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.979990 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.980223 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.980309 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.980478 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.980572 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.980801 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.980887 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.981117 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.981204 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.981426 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.981511 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.981730 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.981821 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.982035 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.982152 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992047 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992160 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992248 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992316 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992392 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992468 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992554 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992554 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992694 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992771 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992846 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.992846 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993074 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993207 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993305 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993305 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993455 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993455 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993615 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993693 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993853 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.993956 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994131 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994229 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994309 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994386 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994476 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994555 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994639 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994724 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994802 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994878 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.994954 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995030 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995114 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995192 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995275 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995353 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995428 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995517 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995606 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995737 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995819 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995896 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.995984 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996070 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996156 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996234 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996310 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996386 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996511 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996603 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996681 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996758 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996840 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996918 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.996995 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997079 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997157 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997233 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997309 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997395 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997481 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997559 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997642 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997719 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997795 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997878 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.997963 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998042 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998166 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998247 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998323 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998401 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998493 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998571 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998647 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998730 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998807 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998883 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.998967 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999051 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999128 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999204 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999280 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999364 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999455 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999534 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999610 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999686 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999849 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:26.999942 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000021 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000104 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000181 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000258 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000340 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000426 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000504 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000580 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000580 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000727 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000810 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000901 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.000979 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001056 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001132 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001207 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001290 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001378 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001463 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001548 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001625 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001701 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001785 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001863 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.001938 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002014 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002110 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002191 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002279 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002368 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002445 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002520 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002608 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002722 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002813 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002892 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.002969 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.003056 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.003134 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.003257 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.003358 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.003479 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.003567 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.003782 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.003869 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.004103 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.004201 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.004428 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.004523 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.004743 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.004830 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.005055 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.005144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.005366 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.005452 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.005687 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:57:27.005813 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.006021 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.006139 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.006631 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.006716 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.006990 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.007200 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.007311 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.007653 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.007738 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.007978 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.008071 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.008313 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.008399 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.008650 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.008734 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.008970 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.009055 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.009303 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.009389 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.009621 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.009713 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.009937 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.010021 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.010278 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.010366 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.010605 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.010700 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.010922 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.011007 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.011242 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.011329 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.011555 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.011649 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.011873 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.011958 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.012195 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.012289 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.012514 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.012691 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.012824 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.013023 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.013164 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.013357 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.013507 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.013686 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.013823 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.014005 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.014175 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.014378 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.014539 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.014753 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.014842 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.015075 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.015168 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.015404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.015497 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.015728 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.015814 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.016045 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.016134 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.016360 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.016452 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.016675 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.016812 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.016985 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.017072 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.017300 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.017386 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.017610 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.017704 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.017924 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.018011 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.018265 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.018367 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.018587 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.018687 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.018902 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.018991 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.019216 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.019309 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.019530 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.019624 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.019844 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.019929 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.020156 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.020242 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.020468 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.020567 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.020779 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.020865 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.021084 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.021177 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.021390 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.021477 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.021714 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.021800 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.022025 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.022328 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.022446 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.022576 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.022664 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.022894 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.022979 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.023208 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.023303 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.023524 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.023610 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.023838 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.023923 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.024165 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.024258 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.024474 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.024559 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.024784 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.024869 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.025089 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.025175 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.025399 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.025483 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.025709 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.025794 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.026013 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.026117 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.026355 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.026441 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.026664 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.026750 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.026981 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.027070 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.027298 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.027385 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.027609 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.027701 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.027941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.028038 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.028258 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.028344 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.028565 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.028659 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.028878 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.028965 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.029186 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.029271 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.029496 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.029594 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.029812 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.029897 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.030152 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.030270 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.030468 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.030572 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.030783 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.030876 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.031099 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.031192 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.031413 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.031506 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.031734 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.031818 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.032050 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.032135 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.032361 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.032454 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.032666 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.032754 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.032976 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.033061 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.033282 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.033369 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.033588 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.033721 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.033890 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.033977 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.034228 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.034318 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.034533 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.034621 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.034837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.034923 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.035141 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.035236 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.035444 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.035530 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.035749 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.035848 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.036056 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.036181 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.036366 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.036452 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.036666 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.036760 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.036969 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.037070 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.037804 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.037900 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.038165 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.038273 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.038483 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.038570 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.038792 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.038881 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.039101 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.039201 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.039410 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.039503 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.039757 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.039850 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.040067 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.040154 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.040413 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.040499 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.040731 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.040824 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.041136 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.043462 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.043558 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.043639 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.043718 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.043785 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.043866 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.043946 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.046176 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.046317 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.046417 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.046498 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.046591 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.046671 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.048890 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.048975 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049052 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049140 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049226 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049294 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049366 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049432 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049496 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049581 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049660 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049746 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049832 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049911 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.049996 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050142 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050225 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050303 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050380 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050456 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050533 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050623 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050702 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050779 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050872 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.050952 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051028 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051117 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051196 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051279 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051365 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051445 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051534 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051614 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051698 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051765 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051835 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051908 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.051981 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052059 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052136 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052220 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052304 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052382 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052467 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052547 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052624 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052707 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052785 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052862 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.052981 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.053549 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.053636 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.053715 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.053792 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.053866 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.053938 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054003 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054089 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054171 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054237 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054309 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054376 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054447 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054526 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054604 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054680 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054769 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054843 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054914 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.054993 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.055070 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.055154 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.055240 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.055325 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.055403 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.055479 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.055556 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.055744 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.055832 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.056055 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.056141 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.056363 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.056449 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.056667 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.056764 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.056980 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.057073 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.057301 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.057398 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.057612 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.057704 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.057922 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.058008 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.058259 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.058347 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.058571 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.058657 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.058877 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.058963 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.059197 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.059282 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.059509 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.059602 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.059813 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.059909 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.060116 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.060216 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.060422 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.060507 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.060749 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.060841 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.061054 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.061147 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.061356 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.061449 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.061662 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.061754 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.061972 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.062066 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.062306 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.062393 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.062621 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.062706 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.062931 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.063027 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.063240 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.063326 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.063557 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.063650 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.063868 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.063998 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.064172 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.064259 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.064481 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.064567 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.064792 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.064880 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.065100 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.065186 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.065408 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.065502 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.065720 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.065812 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.066025 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.066127 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.066361 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.066487 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.066671 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.066766 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.066976 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.067062 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.067287 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.067385 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.067598 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.067683 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.067914 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.068170 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.068256 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.068510 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.068795 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.068889 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.069121 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.069207 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.069445 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.069539 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.069783 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.070022 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.070143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.070395 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.070482 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.070724 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.070817 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.071054 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.071153 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.071384 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.071470 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.071689 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.071786 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.071998 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.072084 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.072312 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.072405 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.072620 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.072707 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.072928 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.073026 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.073234 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.073323 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.073547 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.073633 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.073852 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.073939 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.074178 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.074280 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.074483 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.074578 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.074791 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.074878 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.075103 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.075189 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.075407 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.075501 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.075713 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.075799 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.076015 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.076100 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.076321 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.076414 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.076629 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.076714 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.076933 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.077018 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.077235 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.077334 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.077538 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.077624 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.077845 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.077935 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.078192 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.078292 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.078506 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.078599 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.078817 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.078910 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.079126 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.079213 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.079434 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.079520 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.079748 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.079842 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.080073 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.080161 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.080376 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.080462 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.080679 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.080773 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.080981 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.081068 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.081288 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.081375 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.081595 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.081689 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.081897 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.081991 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.082231 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.082319 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.082542 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.082643 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.082849 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.082937 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.083157 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.083242 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.083459 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.083553 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.083761 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.083846 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.084060 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.084145 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.084404 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.084505 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.084737 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.084910 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.085012 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.085105 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.085316 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.085403 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.085623 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.085708 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.085928 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.086021 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.086252 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.086341 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.086562 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.086692 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.086864 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.086956 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.087171 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.087259 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.087470 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.087556 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.087771 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.087857 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.088072 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.088161 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.088379 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.088465 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.088682 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.088847 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.088980 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.089065 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.089294 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.089418 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.089600 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.089693 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.089903 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.089997 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.090228 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.090318 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.090538 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.090898 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.091104 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.091190 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.091405 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.091499 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.091712 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.091812 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.092023 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.092115 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.092332 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.092426 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.092718 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.092939 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.093023 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.093240 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.093332 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.093545 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.093632 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.093849 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.093942 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.094192 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.094280 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.094501 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.094595 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.094803 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.094887 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.095105 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.095191 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.095408 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.095495 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.095710 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.095795 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.096021 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.096115 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.096327 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.096413 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.096629 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.096721 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.096929 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.097022 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.097232 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.097328 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.097537 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.097624 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.097858 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.097952 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.098199 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.098297 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.098510 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.098596 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.098819 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.098917 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.099125 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.099217 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.099435 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.099551 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.099749 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.100398 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.100586 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.100766 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.100905 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.101074 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.101171 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.101395 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.101481 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.101721 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.101814 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.102039 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.102157 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.102372 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.102458 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.102688 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.102773 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.102996 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.103090 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.103308 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.103401 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.103621 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.103706 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.103938 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.104026 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.104247 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.104333 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.104546 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.104631 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.104854 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.104940 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.105169 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.105253 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.105474 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.105571 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.105782 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.105869 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.106122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.106213 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.106425 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.106511 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.106737 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.106824 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.107044 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.107130 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.107356 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.107450 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.107664 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.107749 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.107967 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.108052 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.108274 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.108369 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.108583 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.108671 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.108886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.108971 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.109200 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.109294 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.109506 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.109592 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.109809 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.109902 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.110140 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.110240 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.110447 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.110541 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.110757 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.110843 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.111056 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.111153 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.111379 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.111471 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.111693 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.111780 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.112003 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.112096 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.112317 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.112403 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.112624 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.112709 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.112938 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.113025 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.113242 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.113328 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.113550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.113668 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.113855 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.113983 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.114295 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.114386 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.114606 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.114703 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.114919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.115004 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.115229 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.115314 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.116176 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.116292 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.116499 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.116597 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.116808 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.116895 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.117218 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.117314 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.117527 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.117621 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.117831 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.117917 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.118162 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.118268 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.118472 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.118557 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.118780 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.118865 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.119093 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.119180 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.119423 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.119510 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.119734 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.119828 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.120042 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.120129 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.120350 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.120493 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.120676 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.120804 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.120986 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.121113 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.121311 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.121432 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.121732 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.121823 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.122048 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.122157 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.122379 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.122473 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.122691 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.122787 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.122997 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.123096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.123318 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.123404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.123638 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.123733 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.123949 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.124035 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.124260 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.124355 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.124561 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.124698 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.124883 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.124980 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.125206 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.125294 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.125517 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.125603 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.125835 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.125930 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.126166 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.126256 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.126487 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.126574 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.126796 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.126894 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.127121 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.127218 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.127448 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.127535 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.127765 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.127852 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.128063 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.128156 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.128372 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.128493 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.128676 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.128826 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.128978 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.129139 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.129299 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.129465 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.129629 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.129792 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.129900 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.130125 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.130226 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.130437 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.130532 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.130751 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.130837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.131081 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.131175 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.131387 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.131478 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.131714 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.131800 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.132024 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.132110 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.132342 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.132437 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.132656 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.132742 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.132968 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.133054 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.133268 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.133367 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.133570 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.133655 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.133880 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.133966 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.134208 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.134299 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.134512 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.134611 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.134816 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.134916 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.135146 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.135238 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.135446 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.135533 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.135761 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.135856 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.136087 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.136174 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.136401 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.136487 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.136704 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.136802 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.137007 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.137093 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.137314 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.137400 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.137648 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.137745 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.137952 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.138032 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.138301 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.138400 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.138608 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.138695 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.138912 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.138999 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.139222 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.139308 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.139524 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.139618 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.139827 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.139914 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.140131 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.140216 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.140439 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.140526 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.140782 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.140876 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.141084 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.141170 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.141386 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.141472 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.141701 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.141786 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.141998 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.142109 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.142331 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.142417 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.142640 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.142725 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.142943 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.143041 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.143246 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.143331 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.143544 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.143630 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.143847 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.143940 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.144169 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.144260 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.144472 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.144558 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.144796 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.144895 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.145110 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.145196 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.145419 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.145504 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.145726 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.145811 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.146029 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.146163 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.146374 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.146461 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.147232 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.147392 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.147533 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.147632 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.147839 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.148011 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.148149 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.148341 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.148453 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.148673 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.148759 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.148988 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.149084 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.149321 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.149454 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.149642 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.149729 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.149960 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.150047 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.150304 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.150503 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.150624 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.150832 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.150948 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.151146 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.151267 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.151459 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.151585 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.151770 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.151906 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.152083 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.152203 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.152394 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.152522 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.152704 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.152842 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.153013 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.153323 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.153409 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.153635 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.153731 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.153961 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.154051 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.154307 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.154397 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.154621 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.154715 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.154940 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.155034 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.155257 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.155343 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.155569 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.155663 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.155879 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.156011 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.156191 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.156278 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.156506 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.156592 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.156838 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.156926 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.157141 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.157227 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.157456 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.157550 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.157770 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.157863 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.158097 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.158243 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.158420 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.158509 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.158732 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.158819 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.159047 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.159206 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.159357 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.159450 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.159667 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.159754 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.159979 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.160084 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.160291 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.160378 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.160605 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.160692 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.160920 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.161007 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.161236 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.161323 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.161553 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.161649 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.161863 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.161949 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.162201 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.162327 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.162781 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.162869 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.163306 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.163394 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.163621 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.163768 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.163952 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.164100 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.164277 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.164439 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.164602 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.164785 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.164917 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.165116 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.165235 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.165440 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.165567 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.165764 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.165875 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.166114 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.166229 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.166581 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.166682 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.166823 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.166961 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.167132 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.167303 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.167483 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.167639 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.167760 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.167974 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.168063 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.168303 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.168395 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.168626 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.168725 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.168960 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.169190 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.169286 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.169539 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.169635 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.169854 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.169958 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.170204 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.170301 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.170515 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.170609 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.170882 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.170962 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.171132 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.171240 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.171442 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.171550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.171746 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.171833 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.172052 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.172140 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.172367 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.172601 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.172689 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.172956 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.173043 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.173256 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.173346 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.173565 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.173660 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.173873 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.173968 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.174201 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.174308 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.174511 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.174598 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.174812 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.174900 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.175139 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.175240 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.175450 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.175543 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.175755 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.175841 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.176059 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.176200 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.176367 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.176460 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.176667 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.176753 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.176969 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.177064 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.177274 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.177362 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.177577 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.177665 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.178408 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.178543 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.178814 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.178902 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.179149 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.179248 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.179468 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.179557 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.179780 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.179866 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.180089 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.180183 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.180408 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.180503 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.180720 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.180853 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.181033 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.181120 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.181345 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.181439 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.181650 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.181736 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.181964 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.182064 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.182300 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.182388 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.182616 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.182704 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.182925 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.183024 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.183236 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.183334 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.183544 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.183630 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.183858 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.183957 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.184217 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.184408 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.184550 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.184749 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.184840 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.185074 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.185185 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.185412 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.185505 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.185746 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.185856 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.186062 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.186264 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.186397 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.186484 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.186699 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.186793 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.187019 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.187112 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.187335 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.187443 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.187712 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.187888 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.187977 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.188230 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.188332 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.188614 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.188711 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.188862 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.188971 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.189169 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.189272 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.189478 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.189659 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.189786 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.189875 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.190113 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.190204 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.190423 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.190525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.190733 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.190820 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.191042 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.191133 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.191354 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.191449 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.191671 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.191759 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.191985 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.192080 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.192298 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.192392 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.192610 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.192704 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.192924 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.193017 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.193235 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.193322 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.193590 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.193682 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.193912 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.193999 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.194256 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.194345 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.194573 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.194662 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.194902 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.195003 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.195217 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.195304 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.195523 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.195609 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.195891 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.195989 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.196214 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.196305 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.196537 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.196625 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.196852 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.196947 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.197162 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.197249 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.197472 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.197558 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.197785 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.197879 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.198110 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.198200 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.198437 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.198535 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.198749 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.198836 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.199057 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.199142 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.199401 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.199488 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.199731 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.199818 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.200055 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.200141 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.200362 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.200514 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.200667 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.200839 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.200972 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.201167 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.201282 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.201496 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.201584 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.201814 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.201907 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.202162 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.202251 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.202484 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.202572 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.202800 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.202892 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.203102 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.203195 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.203405 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.203492 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.203710 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.203802 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.204014 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.204109 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.204324 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.204410 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.204628 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.204715 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.204930 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.205025 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.205233 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.205327 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.205537 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.205625 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.205845 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.205940 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.206171 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.206275 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.206483 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.206570 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.206785 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.206881 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.207088 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.207176 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.207390 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.207476 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.207693 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.207781 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.207995 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.208082 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.208300 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.208394 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.208610 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.208705 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.208919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.209050 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.209775 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.209869 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.210209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.210300 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.210536 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.210622 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.210848 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.210947 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.211156 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.211243 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.211467 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.211554 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.211778 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.211873 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.212085 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.212171 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.212389 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.212475 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.212713 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.212808 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.213025 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.213116 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.213338 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.213424 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.213648 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.213744 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.213959 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.214053 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.214294 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.214385 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.214610 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.214711 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.214934 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.215034 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.215243 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.215337 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.215563 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.215902 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.216137 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.216224 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.216460 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.216558 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.216776 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.216863 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.217087 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.217174 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.217402 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.217489 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.217711 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.217798 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.218020 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.218223 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.218361 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.218458 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.218671 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.218758 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.218979 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.219073 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.219295 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.219459 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.219610 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.219697 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.219935 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.220021 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.220257 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.220352 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.220564 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.220649 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.220881 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.220967 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.221201 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.221288 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.221515 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.221601 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.221830 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.221917 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.222172 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.222262 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.222491 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.222586 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.222809 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.222902 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.223119 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.223206 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.223425 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.223513 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.223670 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 15:57:27.223766 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.224067 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.224380 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.224711 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.225192 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.225637 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.225962 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.226337 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.226675 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.226996 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.227315 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.227627 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:57:27.227877 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 15:57:27.282460 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO dbcounter [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Registered counter for database nova_api Jun 02 15:57:27.287190 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO dbcounter [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Registered counter for database nova_api Jun 02 15:57:27.303590 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_db.sqlalchemy.engines [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:57:27.307791 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG oslo_db.sqlalchemy.engines [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:57:27.312379 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writer thread running {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:57:27.315404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writer thread running {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:57:27.369539 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.context [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dabfd63-010b-4913-be80-9c36dccab098(cell1) {{(pid=103835) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 15:57:27.373645 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 15:57:27.373878 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.context [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dabfd63-010b-4913-be80-9c36dccab098(cell1) {{(pid=103834) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 15:57:27.375239 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 15:57:27.376017 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 15:57:27.377967 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 15:57:27.378060 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG oslo_concurrency.lockutils [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 15:57:27.379597 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG oslo_concurrency.lockutils [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 15:57:27.379970 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO dbcounter [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Registered counter for database nova_cell0 Jun 02 15:57:27.380395 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG oslo_concurrency.lockutils [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 15:57:27.382918 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG oslo_concurrency.lockutils [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 15:57:27.383957 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO dbcounter [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Registered counter for database nova_cell1 Jun 02 15:57:27.384927 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO dbcounter [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Registered counter for database nova_cell0 Jun 02 15:57:27.389121 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO dbcounter [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Registered counter for database nova_cell1 Jun 02 15:57:27.391367 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_db.sqlalchemy.engines [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:57:27.393400 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_db.sqlalchemy.engines [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:57:27.396041 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG oslo_db.sqlalchemy.engines [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:57:27.398678 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG oslo_db.sqlalchemy.engines [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:57:27.400290 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writer thread running {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:57:27.401524 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writer thread running {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:57:27.404657 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writer thread running {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:57:27.406705 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writer thread running {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:57:27.547451 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO dbcounter [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Registered counter for database nova_cell0 Jun 02 15:57:27.556383 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_db.sqlalchemy.engines [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:57:27.559307 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO dbcounter [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Registered counter for database nova_cell0 Jun 02 15:57:27.560783 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writer thread running {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:57:27.567920 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG oslo_db.sqlalchemy.engines [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:57:27.573125 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writer thread running {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:57:28.085191 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: WARNING keystonemiddleware.auth_token [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 15:57:28.092906 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: WARNING keystonemiddleware.auth_token [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 15:57:28.118087 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: WARNING keystonemiddleware.auth_token [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 15:57:28.125293 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: WARNING keystonemiddleware.auth_token [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 15:57:28.334758 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: WARNING keystonemiddleware.auth_token [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 15:57:28.341083 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: WARNING keystonemiddleware.auth_token [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 15:57:28.346191 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599b95449c0 pid: 103835 (default app) Jun 02 15:57:28.348517 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:57:28.349683 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001952 Jun 02 15:57:28.350646 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Thu Jun 2 15:57:28 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:57:28.370364 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: WARNING keystonemiddleware.auth_token [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 15:57:28.376543 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: WARNING keystonemiddleware.auth_token [None req-7285f51c-5119-468b-bc2d-1124b7676505 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 15:57:28.381906 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599b95449c0 pid: 103834 (default app) Jun 02 15:58:49.942451 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:58:49.943439 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 02 15:58:49.943822 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:58:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:58:49.955807 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writing DB stats nova_api:SELECT=3 {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:49.956666 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writing DB stats nova_cell1:SELECT=3 {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:49.957661 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writing DB stats nova_cell0:SELECT=3 {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:49.958663 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:50.537240 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-242d5c15-795b-48df-b432-446ef475dfce admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:58:50.566866 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-242d5c15-795b-48df-b432-446ef475dfce admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.616086 Jun 02 15:58:50.567742 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jun 2 15:58:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:58:52.890490 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:58:52.891504 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-38cfa640-3318-4908-8bd8-cb09b2983662 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 02 15:58:52.894384 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:58:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:58:52.957938 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-25e4607e-089a-4866-8ff8-c6960d2035c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:58:52.979533 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 15:58:52.979533 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: warnings.warn(msg) Jun 02 15:58:53.068765 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-25e4607e-089a-4866-8ff8-c6960d2035c3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.170230 Jun 02 15:58:53.069481 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:58:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:58:53.082828 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_api:SELECT=3 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:53.083824 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_cell1:SELECT=3 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:53.084728 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_cell0:SELECT=3 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:53.085812 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:53.290354 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-6d07a070-d7d5-4406-94d3-5ccca24d5b5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:58:53.292760 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 15:58:53.292760 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: warnings.warn(msg) Jun 02 15:58:53.438389 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-6d07a070-d7d5-4406-94d3-5ccca24d5b5b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.347059 Jun 02 15:58:53.438389 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 2 15:58:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:58:55.764830 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-25e4607e-089a-4866-8ff8-c6960d2035c3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:58:55.765838 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-25e4607e-089a-4866-8ff8-c6960d2035c3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 02 15:58:55.766273 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:58:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:58:55.871597 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-1c9795dd-2424-4410-87ad-760c34742d71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "vcpus": 1}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:58:55.890253 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 15:58:55.890253 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: warnings.warn(msg) Jun 02 15:58:55.981080 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-1c9795dd-2424-4410-87ad-760c34742d71 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.208683 Jun 02 15:58:55.983806 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:58:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 15:58:55.993972 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-f8d4c146-fbf8-4fda-8f6d-946695725898 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:58:55.998115 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 15:58:55.998115 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: warnings.warn(msg) Jun 02 15:58:56.082589 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-f8d4c146-fbf8-4fda-8f6d-946695725898 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092268 Jun 02 15:58:56.083362 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 2 15:58:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:58:58.403343 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-1c9795dd-2424-4410-87ad-760c34742d71 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:58:58.404379 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-1c9795dd-2424-4410-87ad-760c34742d71 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 02 15:58:58.404966 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:58:58.471310 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-b30f44ee-e238-4880-a3d4-701e88aa3ed5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 10, "name": "ds1G", "swap": 0, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:58:58.546200 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-b30f44ee-e238-4880-a3d4-701e88aa3ed5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134621 Jun 02 15:58:58.547055 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:58:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:58:58.559607 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-02897374-7a12-4be3-bdb9-cb40053db954 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:58:58.648718 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-02897374-7a12-4be3-bdb9-cb40053db954 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092759 Jun 02 15:58:58.649329 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 2 15:58:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:59:00.947932 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-b30f44ee-e238-4880-a3d4-701e88aa3ed5 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:00.948966 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-b30f44ee-e238-4880-a3d4-701e88aa3ed5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 02 15:59:00.949381 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:01.013497 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-49772799-ebd6-4db0-bae8-0bfd7dde81a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "ram": 2048}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:01.123007 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-49772799-ebd6-4db0-bae8-0bfd7dde81a2 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165629 Jun 02 15:59:01.123562 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:59:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:01.136660 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-4d8dc3e6-8b7b-41ad-a3af-f8967c957bf4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:01.224856 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-4d8dc3e6-8b7b-41ad-a3af-f8967c957bf4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092077 Jun 02 15:59:01.225441 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 2 15:59:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:59:03.551787 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-49772799-ebd6-4db0-bae8-0bfd7dde81a2 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:03.552795 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-49772799-ebd6-4db0-bae8-0bfd7dde81a2 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 02 15:59:03.553189 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 15:59:03.613256 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-fdfd89dd-4e58-41d4-8bc9-2477c1519da5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "ram": 4096}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:03.678824 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-fdfd89dd-4e58-41d4-8bc9-2477c1519da5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.119692 Jun 02 15:59:03.679737 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:59:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:03.692059 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-0142ec90-dfb2-494e-90b1-f545bb769e29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:03.754888 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-0142ec90-dfb2-494e-90b1-f545bb769e29 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066791 Jun 02 15:59:03.755518 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jun 2 15:59:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:59:06.090982 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-fdfd89dd-4e58-41d4-8bc9-2477c1519da5 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:06.091994 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-fdfd89dd-4e58-41d4-8bc9-2477c1519da5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 02 15:59:06.092402 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:06.154796 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-891d59c0-7b17-47f4-8600-dace485ca733 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:06.182467 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-891d59c0-7b17-47f4-8600-dace485ca733 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083543 Jun 02 15:59:06.183017 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jun 2 15:59:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 15:59:08.545192 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-fdfd89dd-4e58-41d4-8bc9-2477c1519da5 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:08.546263 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-fdfd89dd-4e58-41d4-8bc9-2477c1519da5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 02 15:59:08.546671 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:08.607553 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-fd4fe09c-d257-401f-975d-2e255929d23f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "rxtx_factor": 1.0}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:08.724035 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-fd4fe09c-d257-401f-975d-2e255929d23f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.171261 Jun 02 15:59:08.724477 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:59:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:08.736683 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-e96da0c4-f57b-4d6c-9fc0-b7345b5550d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:08.818456 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-e96da0c4-f57b-4d6c-9fc0-b7345b5550d3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085725 Jun 02 15:59:08.819055 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 2 15:59:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:59:11.306616 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-fd4fe09c-d257-401f-975d-2e255929d23f admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:11.307727 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-fd4fe09c-d257-401f-975d-2e255929d23f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 Jun 02 15:59:11.308130 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:11.367921 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-197dce0e-41f9-4be9-a542-fb24171933f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:11.448678 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-197dce0e-41f9-4be9-a542-fb24171933f3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133815 Jun 02 15:59:11.449273 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:59:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:11.461703 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-793eada0-95d5-4a94-af5c-252eb6c153d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:11.543924 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-793eada0-95d5-4a94-af5c-252eb6c153d8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086036 Jun 02 15:59:11.544522 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 2 15:59:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 15:59:14.035144 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-197dce0e-41f9-4be9-a542-fb24171933f3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:14.036155 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-197dce0e-41f9-4be9-a542-fb24171933f3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 02 15:59:14.036555 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:14.097426 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-4f95d22f-2c5b-4e6b-ad85-d2acade8005e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:14.163113 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-4f95d22f-2c5b-4e6b-ad85-d2acade8005e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.120906 Jun 02 15:59:14.163675 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:59:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:14.176173 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-c467fde5-7f4f-4bc1-ab12-80eb14a13fce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:14.280301 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-c467fde5-7f4f-4bc1-ab12-80eb14a13fce admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108444 Jun 02 15:59:14.281649 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 2 15:59:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:59:16.571296 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-4f95d22f-2c5b-4e6b-ad85-d2acade8005e admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:16.572307 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-4f95d22f-2c5b-4e6b-ad85-d2acade8005e admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 02 15:59:16.572704 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:16.630547 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-f17a88cd-35b7-4f47-a78f-f2a02ba6c864 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "vcpus": 4}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:16.711108 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-f17a88cd-35b7-4f47-a78f-f2a02ba6c864 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132488 Jun 02 15:59:16.711592 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:59:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 15:59:16.724229 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-66bff68d-027c-4a34-822d-1d340b4239c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:16.801278 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-66bff68d-027c-4a34-822d-1d340b4239c1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080686 Jun 02 15:59:16.801871 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 2 15:59:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:59:19.294255 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-f17a88cd-35b7-4f47-a78f-f2a02ba6c864 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:19.295324 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-f17a88cd-35b7-4f47-a78f-f2a02ba6c864 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Jun 02 15:59:19.295802 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:19.359209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-9ab817e2-f4ed-4cc0-a4cd-41166bae38c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:19.455307 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-9ab817e2-f4ed-4cc0-a4cd-41166bae38c4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.153111 Jun 02 15:59:19.455868 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jun 2 15:59:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:19.468404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-89bc2a40-f3d4-40c1-abb5-776b3d161fa2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:19.549887 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-89bc2a40-f3d4-40c1-abb5-776b3d161fa2 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085639 Jun 02 15:59:19.550793 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jun 2 15:59:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 15:59:44.329072 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-9ab817e2-f4ed-4cc0-a4cd-41166bae38c4 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:44.330093 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-9ab817e2-f4ed-4cc0-a4cd-41166bae38c4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 02 15:59:44.330488 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 15:59:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 15:59:44.341172 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:44.389821 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-3f7efba0-5387-4d1d-8d5e-9c039d8ed658 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:44.406776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-3f7efba0-5387-4d1d-8d5e-9c039d8ed658 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070390 Jun 02 15:59:44.407323 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jun 2 15:59:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 15:59:45.396870 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-9ab817e2-f4ed-4cc0-a4cd-41166bae38c4 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:45.397886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-9ab817e2-f4ed-4cc0-a4cd-41166bae38c4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 02 15:59:45.398422 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 15:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:45.605525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-7fe59f85-44cb-47ee-b2da-0194c1678fa3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:45.611315 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.wsgi [None req-7fe59f85-44cb-47ee-b2da-0194c1678fa3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-7fe59f85-44cb-47ee-b2da-0194c1678fa3 admin admin] Request method failure captured: Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Accept: application/json Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Accept-Encoding: gzip, deflate Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Connection: keep-alive Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Content-Length: 0 Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Host: 10.222.0.59 Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Openstack-Api-Version: compute 2.90 Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Openstack-System-Scope: None Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: User-Agent: python-novaclient Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Auth-Token: gAAAAABimN5xoCkJHhU9aerXHxO0EG01SWvviojmf8m4thCjtzGE7Yv3QomJxOKtog8OwBM7kIs-emdjGOgX7Vtwz2Gmor8gyHbg4_CM-cdwEsTqT8UV0e8SCKMyvdfW4avLdNtD8GnxL5-HxUT7GenTx12_X28H1CP7AIAy5zYcJwxawRZnu_I Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Domain-Id: None Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Domain-Name: None Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Identity-Status: Confirmed Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Is-Admin-Project: True Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Domain-Id: default Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Domain-Name: Default Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Name: admin Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Role: admin,member,reader Jun 02 15:59:45.614562 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Roles: admin,member,reader Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f73d5a98be74242b45222df39fb6213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}] Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Tenant: admin Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Tenant-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Tenant-Name: admin Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User: admin Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Domain-Id: default Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Domain-Name: Default Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Id: 400d1f4db9de49638549e5db29a041e1 Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Name: admin Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: method: > Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: exception: Flavor 42 could not be found. Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: action_args: {'id': '42'} Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 15:59:45.616096 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:45.617001 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.621525 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-7fe59f85-44cb-47ee-b2da-0194c1678fa3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 15:59:45.623607 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-7fe59f85-44cb-47ee-b2da-0194c1678fa3 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064321 Jun 02 15:59:45.623607 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jun 2 15:59:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:45.630411 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-f0889dd3-ca33-4e9f-9221-6319857e33c1 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:45.633356 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:45.653169 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-f0889dd3-ca33-4e9f-9221-6319857e33c1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026330 Jun 02 15:59:45.653654 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 2 15:59:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 15:59:45.663993 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-29c2a756-4651-4a6e-94bb-6b13ffa016eb admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:45.685225 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-29c2a756-4651-4a6e-94bb-6b13ffa016eb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024967 Jun 02 15:59:45.689455 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 2 15:59:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 15:59:45.697454 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-772ce6af-3ea3-4b02-a16a-2208ebdf6a9f admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:45.703619 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.wsgi [None req-772ce6af-3ea3-4b02-a16a-2208ebdf6a9f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-772ce6af-3ea3-4b02-a16a-2208ebdf6a9f admin admin] Request method failure captured: Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Accept: application/json Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Accept-Encoding: gzip, deflate Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Connection: keep-alive Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Content-Length: 0 Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Host: 10.222.0.59 Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Openstack-Api-Version: compute 2.90 Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Openstack-System-Scope: None Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: User-Agent: python-novaclient Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Auth-Token: gAAAAABimN5xoCkJHhU9aerXHxO0EG01SWvviojmf8m4thCjtzGE7Yv3QomJxOKtog8OwBM7kIs-emdjGOgX7Vtwz2Gmor8gyHbg4_CM-cdwEsTqT8UV0e8SCKMyvdfW4avLdNtD8GnxL5-HxUT7GenTx12_X28H1CP7AIAy5zYcJwxawRZnu_I Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Domain-Id: None Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Domain-Name: None Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Identity-Status: Confirmed Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Is-Admin-Project: True Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Domain-Id: default Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Domain-Name: Default Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Name: admin Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Role: admin,member,reader Jun 02 15:59:45.706837 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Roles: admin,member,reader Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f73d5a98be74242b45222df39fb6213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}] Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Tenant: admin Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Tenant-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Tenant-Name: admin Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User: admin Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Domain-Id: default Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Domain-Name: Default Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Id: 400d1f4db9de49638549e5db29a041e1 Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Name: admin Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: method: > Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: exception: Flavor 42 could not be found. Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: action_args: {'id': '42'} Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 15:59:45.713209 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:45.714589 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:45.715886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-772ce6af-3ea3-4b02-a16a-2208ebdf6a9f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 15:59:45.717285 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-772ce6af-3ea3-4b02-a16a-2208ebdf6a9f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014385 Jun 02 15:59:45.717285 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jun 2 15:59:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:46.577355 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-29c2a756-4651-4a6e-94bb-6b13ffa016eb admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:46.578449 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-29c2a756-4651-4a6e-94bb-6b13ffa016eb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Jun 02 15:59:46.578851 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 15:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:46.769607 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-84f0260e-dae6-416c-af1b-2b2ee48544cf admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:46.775202 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.wsgi [None req-84f0260e-dae6-416c-af1b-2b2ee48544cf admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-84f0260e-dae6-416c-af1b-2b2ee48544cf admin admin] Request method failure captured: Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Accept: application/json Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Accept-Encoding: gzip, deflate Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Connection: keep-alive Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Content-Length: 0 Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Host: 10.222.0.59 Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Openstack-Api-Version: compute 2.90 Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Openstack-System-Scope: None Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: User-Agent: python-novaclient Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Auth-Token: gAAAAABimN5yWEjR7NLQrmmjAQo6XHzI2JeD6yzlf-e5Mjb78wAjt51Hg-CntAQzitzIvWUUH87_jIqR12I-wPdpWzFhS2JbVXVzS0Ayo8dIDDWDMNtGi0EW0s6CiF_8pYDGVbrCKXmOmohMtt7ztf0xOJamxhKEwP5GPBlDNhV__bwhCUovO7w Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Domain-Id: None Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Domain-Name: None Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Identity-Status: Confirmed Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Is-Admin-Project: True Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Domain-Id: default Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Domain-Name: Default Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Name: admin Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Role: admin,member,reader Jun 02 15:59:46.776266 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Roles: admin,member,reader Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f73d5a98be74242b45222df39fb6213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}] Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Tenant: admin Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Tenant-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Tenant-Name: admin Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User: admin Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Domain-Id: default Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Domain-Name: Default Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Id: 400d1f4db9de49638549e5db29a041e1 Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Name: admin Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: method: > Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: exception: Flavor 84 could not be found. Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: action_args: {'id': '84'} Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 15:59:46.777631 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:46.778598 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.780122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-84f0260e-dae6-416c-af1b-2b2ee48544cf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 15:59:46.781405 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-84f0260e-dae6-416c-af1b-2b2ee48544cf admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060667 Jun 02 15:59:46.781405 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jun 2 15:59:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:46.787413 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-dcf26600-10aa-4085-b57e-ed14b09ec0b8 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:46.801848 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-dcf26600-10aa-4085-b57e-ed14b09ec0b8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018070 Jun 02 15:59:46.802470 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 2 15:59:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 15:59:46.812196 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-9eb82825-e48e-4984-b80f-ef3041e4f316 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:46.826340 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-9eb82825-e48e-4984-b80f-ef3041e4f316 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018192 Jun 02 15:59:46.826899 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 2 15:59:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 15:59:46.835879 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-aca825d4-36e7-4da6-a38d-e8a3c7a8c348 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:46.841380 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.wsgi [None req-aca825d4-36e7-4da6-a38d-e8a3c7a8c348 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-aca825d4-36e7-4da6-a38d-e8a3c7a8c348 admin admin] Request method failure captured: Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Accept: application/json Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Accept-Encoding: gzip, deflate Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Connection: keep-alive Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Content-Length: 0 Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Host: 10.222.0.59 Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Openstack-Api-Version: compute 2.90 Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Openstack-System-Scope: None Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: User-Agent: python-novaclient Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Auth-Token: gAAAAABimN5yWEjR7NLQrmmjAQo6XHzI2JeD6yzlf-e5Mjb78wAjt51Hg-CntAQzitzIvWUUH87_jIqR12I-wPdpWzFhS2JbVXVzS0Ayo8dIDDWDMNtGi0EW0s6CiF_8pYDGVbrCKXmOmohMtt7ztf0xOJamxhKEwP5GPBlDNhV__bwhCUovO7w Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Domain-Id: None Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Domain-Name: None Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Identity-Status: Confirmed Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Is-Admin-Project: True Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Domain-Id: default Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Domain-Name: Default Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Name: admin Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Role: admin,member,reader Jun 02 15:59:46.843069 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Roles: admin,member,reader Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f73d5a98be74242b45222df39fb6213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}] Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Tenant: admin Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Tenant-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Tenant-Name: admin Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User: admin Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Domain-Id: default Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Domain-Name: Default Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Id: 400d1f4db9de49638549e5db29a041e1 Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Name: admin Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: method: > Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: exception: Flavor 84 could not be found. Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: action_args: {'id': '84'} Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 15:59:46.844738 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:46.845776 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:46.847119 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-aca825d4-36e7-4da6-a38d-e8a3c7a8c348 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 15:59:46.848360 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-aca825d4-36e7-4da6-a38d-e8a3c7a8c348 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012008 Jun 02 15:59:46.848360 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jun 2 15:59:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:47.717440 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-9eb82825-e48e-4984-b80f-ef3041e4f316 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:47.718518 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-9eb82825-e48e-4984-b80f-ef3041e4f316 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Jun 02 15:59:47.718944 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 15:59:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:47.907574 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-6c12cbf2-f340-4a88-9c78-ddd6a6a25aae admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:47.912847 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.wsgi [None req-6c12cbf2-f340-4a88-9c78-ddd6a6a25aae admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-6c12cbf2-f340-4a88-9c78-ddd6a6a25aae admin admin] Request method failure captured: Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Accept: application/json Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Accept-Encoding: gzip, deflate Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Connection: keep-alive Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Content-Length: 0 Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Host: 10.222.0.59 Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Openstack-Api-Version: compute 2.90 Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Openstack-System-Scope: None Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: User-Agent: python-novaclient Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Auth-Token: gAAAAABimN5z2S2o6biExacKvKaFx8ZQ3p-pt1Jre_VS26d9-kndugKdkHMboVO80DloQawzvbCA0f1W-Tquj5HPBQT3lenPqwZCZea3e14bxOqmexlEx7sFVCwuWyxxnfwULhPhFMhmAPPDt9bqzp03TANu0JehqCHnd5-AJpqZivnWtBSj-f4 Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Domain-Id: None Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Domain-Name: None Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Identity-Status: Confirmed Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Is-Admin-Project: True Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Domain-Id: default Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Domain-Name: Default Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Project-Name: admin Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Role: admin,member,reader Jun 02 15:59:47.914404 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Roles: admin,member,reader Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f73d5a98be74242b45222df39fb6213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}] Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Tenant: admin Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Tenant-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-Tenant-Name: admin Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User: admin Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Domain-Id: default Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Domain-Name: Default Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Id: 400d1f4db9de49638549e5db29a041e1 Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: X-User-Name: admin Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: method: > Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: exception: Flavor 451 could not be found. Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: action_args: {'id': '451'} Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 15:59:47.915919 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:47.916803 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.917941 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-6c12cbf2-f340-4a88-9c78-ddd6a6a25aae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 15:59:47.922624 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-6c12cbf2-f340-4a88-9c78-ddd6a6a25aae admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059567 Jun 02 15:59:47.922624 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 2 15:59:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:47.927536 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-c25c7d56-1f36-429f-a178-5f3a895d9676 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:47.941561 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-c25c7d56-1f36-429f-a178-5f3a895d9676 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018075 Jun 02 15:59:47.942122 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 2 15:59:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 15:59:47.952197 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:47.965575 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017491 Jun 02 15:59:47.966134 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jun 2 15:59:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 15:59:47.975795 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-ebe61faa-cf91-4e2a-bd7c-802c4be252d0 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:47.981227 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.wsgi [None req-ebe61faa-cf91-4e2a-bd7c-802c4be252d0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-ebe61faa-cf91-4e2a-bd7c-802c4be252d0 admin admin] Request method failure captured: Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Accept: application/json Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Accept-Encoding: gzip, deflate Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Connection: keep-alive Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Content-Length: 0 Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Host: 10.222.0.59 Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Openstack-Api-Version: compute 2.90 Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Openstack-System-Scope: None Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: User-Agent: python-novaclient Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Auth-Token: gAAAAABimN5z2S2o6biExacKvKaFx8ZQ3p-pt1Jre_VS26d9-kndugKdkHMboVO80DloQawzvbCA0f1W-Tquj5HPBQT3lenPqwZCZea3e14bxOqmexlEx7sFVCwuWyxxnfwULhPhFMhmAPPDt9bqzp03TANu0JehqCHnd5-AJpqZivnWtBSj-f4 Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Domain-Id: None Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Domain-Name: None Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Identity-Status: Confirmed Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Is-Admin-Project: True Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Domain-Id: default Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Domain-Name: Default Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Project-Name: admin Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Role: admin,member,reader Jun 02 15:59:47.983550 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Roles: admin,member,reader Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f73d5a98be74242b45222df39fb6213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f73d5a98be74242b45222df39fb6213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f73d5a98be74242b45222df39fb6213"}]}] Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Tenant: admin Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Tenant-Id: 4f73d5a98be74242b45222df39fb6213 Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-Tenant-Name: admin Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User: admin Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Domain-Id: default Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Domain-Name: Default Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Id: 400d1f4db9de49638549e5db29a041e1 Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: X-User-Name: admin Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: method: > Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: exception: Flavor 451 could not be found. Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: action_args: {'id': '451'} Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 15:59:47.985143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:47.986144 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: ERROR nova.api.openstack.wsgi Jun 02 15:59:47.987286 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-ebe61faa-cf91-4e2a-bd7c-802c4be252d0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 15:59:47.988280 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-ebe61faa-cf91-4e2a-bd7c-802c4be252d0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012699 Jun 02 15:59:47.988280 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 2 15:59:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:48.860014 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:48.861027 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 02 15:59:48.861430 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 15:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:49.047392 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-de38aa0c-4269-4306-8a3e-5231e87bd7d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:49.131983 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-de38aa0c-4269-4306-8a3e-5231e87bd7d8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.135176 Jun 02 15:59:49.132496 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jun 2 15:59:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:50.004733 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:50.005746 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 02 15:59:50.006166 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 15:59:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:50.199881 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-c9bdbe44-7ba4-459d-a1f6-c1b32800714c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:50.275421 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-c9bdbe44-7ba4-459d-a1f6-c1b32800714c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.131590 Jun 02 15:59:50.275978 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jun 2 15:59:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:51.138474 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:51.139353 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 02 15:59:51.139753 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 15:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:51.339686 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-4a51bb11-7c55-46de-8cc1-a124b3ec7724 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:51.400924 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-4a51bb11-7c55-46de-8cc1-a124b3ec7724 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.113830 Jun 02 15:59:51.401400 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jun 2 15:59:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:52.268860 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:52.269857 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 02 15:59:52.270290 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 15:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:52.457200 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-70ac6fa8-94d9-40fd-b933-468cd0435bad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 15:59:52.521525 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-70ac6fa8-94d9-40fd-b933-468cd0435bad admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.116713 Jun 02 15:59:52.522066 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jun 2 15:59:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 15:59:53.384131 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:53.385143 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 02 15:59:53.385553 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 15:59:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 15:59:53.573444 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-008fc4ec-20d0-452d-ac36-d2c408a26572 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 15:59:53.593683 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-008fc4ec-20d0-452d-ac36-d2c408a26572 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071715 Jun 02 15:59:53.594249 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Thu Jun 2 15:59:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:00:54.971517 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:00:54.972528 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-8fd6900d-6fdd-4fd0-afd5-9c1a3c44d3d3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 02 16:00:54.972945 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jun 2 16:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:00:54.980971 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:00:55.031316 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-f7677398-7e64-481a-adf2-c53d909e5852 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:00:55.051098 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-f7677398-7e64-481a-adf2-c53d909e5852 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071605 Jun 02 16:00:55.051638 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jun 2 16:00:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:00:55.072954 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG dbcounter [-] [103834] Writing DB stats nova_api:SELECT=14 {{(pid=103834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:00:55.076711 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-b1ec92cd-2e4b-4fef-b77b-8a005eeb6525 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:00:55.084334 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-b1ec92cd-2e4b-4fef-b77b-8a005eeb6525 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012957 Jun 02 16:00:55.084882 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1282 bytes} [Thu Jun 2 16:00:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:00:55.096566 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-75a1209b-fb66-4ef3-acec-eecc3340f59c admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:00:55.105009 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-75a1209b-fb66-4ef3-acec-eecc3340f59c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012041 Jun 02 16:00:55.105523 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1285 bytes} [Thu Jun 2 16:00:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:00:55.116787 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:00:55.125248 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012275 Jun 02 16:00:55.125784 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1285 bytes} [Thu Jun 2 16:00:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:00:55.137123 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-86746518-bed8-4180-966e-2d7fd2d72352 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:00:55.144630 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-86746518-bed8-4180-966e-2d7fd2d72352 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011375 Jun 02 16:00:55.145143 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1282 bytes} [Thu Jun 2 16:00:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:04:21.088440 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:04:21.089462 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 02 16:04:21.089868 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 16:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:04:21.247956 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_api:SELECT=6 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:21.363988 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-75fc1c3b-bcda-40ae-8932-c19be4eea011 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:04:21.365177 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:04:21.365177 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: warnings.warn(msg) Jun 02 16:04:21.366445 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-75fc1c3b-bcda-40ae-8932-c19be4eea011 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:04:21.366886 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-75fc1c3b-bcda-40ae-8932-c19be4eea011 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:04:21.367670 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-75fc1c3b-bcda-40ae-8932-c19be4eea011 admin admin] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:04:21.368100 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-75fc1c3b-bcda-40ae-8932-c19be4eea011 admin admin] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:04:21.403077 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-75fc1c3b-bcda-40ae-8932-c19be4eea011 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.156976 Jun 02 16:04:21.403644 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 2 16:04:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:04:22.275761 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:04:22.276761 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 02 16:04:22.277158 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 16:04:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:04:22.470784 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-0ec9949f-03ae-47bd-8302-c51fda5b96c0 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:04:22.471934 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:04:22.471934 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: warnings.warn(msg) Jun 02 16:04:22.473123 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-0ec9949f-03ae-47bd-8302-c51fda5b96c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:04:22.473552 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-0ec9949f-03ae-47bd-8302-c51fda5b96c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:04:22.474388 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-0ec9949f-03ae-47bd-8302-c51fda5b96c0 admin admin] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:04:22.474808 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-0ec9949f-03ae-47bd-8302-c51fda5b96c0 admin admin] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:04:22.494786 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-0ec9949f-03ae-47bd-8302-c51fda5b96c0 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075427 Jun 02 16:04:22.495335 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 2 16:04:22 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:04:33.821689 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:04:33.822739 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 02 16:04:33.823138 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 16:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:04:33.965918 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_cell0:SELECT=4 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:33.966663 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_cell1:SELECT=4 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:33.967279 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG dbcounter [-] [103835] Writing DB stats nova_api:SELECT=8 {{(pid=103835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:34.014843 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-78f86aa4-107d-4666-86ae-4815b3d57e45 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:04:34.021708 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:04:34.021708 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: warnings.warn(msg) Jun 02 16:04:34.021708 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-78f86aa4-107d-4666-86ae-4815b3d57e45 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:04:34.021708 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-78f86aa4-107d-4666-86ae-4815b3d57e45 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:04:34.021708 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-78f86aa4-107d-4666-86ae-4815b3d57e45 admin admin] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:04:34.021708 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-78f86aa4-107d-4666-86ae-4815b3d57e45 admin admin] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:04:34.043488 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-78f86aa4-107d-4666-86ae-4815b3d57e45 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.081874 Jun 02 16:04:34.043973 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 2 16:04:33 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:04:34.961607 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: DEBUG nova.api.openstack.wsgi [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] Calling method '>' {{(pid=103834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:04:34.962650 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: INFO nova.api.openstack.requestlog [None req-2ec56e24-95cb-4bc8-bc81-fc14701819d5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 02 16:04:34.963057 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: [pid: 103834|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jun 2 16:04:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:04:35.152747 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG nova.api.openstack.wsgi [None req-2a8b5f8c-0933-4755-91ab-9e11a526a503 admin admin] Calling method '>' {{(pid=103835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:04:35.153940 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:04:35.153940 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: warnings.warn(msg) Jun 02 16:04:35.155169 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-2a8b5f8c-0933-4755-91ab-9e11a526a503 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:04:35.155620 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-2a8b5f8c-0933-4755-91ab-9e11a526a503 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:04:35.157647 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-2a8b5f8c-0933-4755-91ab-9e11a526a503 admin admin] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:04:35.158104 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: DEBUG oslo_concurrency.lockutils [None req-2a8b5f8c-0933-4755-91ab-9e11a526a503 admin admin] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:04:35.180645 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: INFO nova.api.openstack.requestlog [None req-2a8b5f8c-0933-4755-91ab-9e11a526a503 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080547 Jun 02 16:04:35.181210 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: [pid: 103835|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jun 2 16:04:35 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:05:35.213675 dv-cinder-797608-27-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 02 16:05:35.214288 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: Thu Jun 2 16:05:35 2022 - graceful shutdown triggered... Jun 02 16:05:35.214743 dv-cinder-797608-27-iscsi devstack@n-api.service[103834]: Gracefully killing worker 1 (pid: 103834)... Jun 02 16:05:35.215103 dv-cinder-797608-27-iscsi devstack@n-api.service[103835]: Gracefully killing worker 2 (pid: 103835)... Jun 02 16:05:36.215143 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: worker 1 buried after 1 seconds Jun 02 16:05:36.215569 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: worker 2 buried after 1 seconds Jun 02 16:05:36.215569 dv-cinder-797608-27-iscsi devstack@n-api.service[103833]: goodbye to uWSGI. Jun 02 16:05:36.216826 dv-cinder-797608-27-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 02 16:05:36.217398 dv-cinder-797608-27-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 02 16:05:36.220072 dv-cinder-797608-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 16:05:36.232613 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 16:05:36 2022] *** Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: nodename: dv-cinder-797608-27-iscsi Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: machine: x86_64 Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: clock source: unix Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: pcre jit disabled Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: detected number of CPU cores: 4 Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: current working directory: / Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: detected binary path: /usr/bin/uwsgi-core Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: your processes number limit is 47680 Jun 02 16:05:36.242253 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: your memory page size is 4096 bytes Jun 02 16:05:36.243184 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: detected max file descriptor number: 2048 Jun 02 16:05:36.243184 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: lock engine: pthread robust mutexes Jun 02 16:05:36.243184 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: thunder lock: enabled Jun 02 16:05:36.243184 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 16:05:36.243184 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 16:05:36.292230 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: Python main interpreter initialized at 0x55b9edbcd9c0 Jun 02 16:05:36.292230 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: python threads support enabled Jun 02 16:05:36.292230 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: your server socket listen backlog is limited to 100 connections Jun 02 16:05:36.292230 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: your mercy for graceful operations on workers is 90 seconds Jun 02 16:05:36.292700 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 16:05:36.292700 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: *** Operational MODE: preforking *** Jun 02 16:05:36.292935 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: *** uWSGI is running in multiple interpreter mode *** Jun 02 16:05:36.292935 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: spawned uWSGI master process (pid: 118237) Jun 02 16:05:36.293143 dv-cinder-797608-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 16:05:36.293723 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: spawned uWSGI worker 1 (pid: 118256, cores: 1) Jun 02 16:05:36.294409 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: spawned uWSGI worker 2 (pid: 118257, cores: 1) Jun 02 16:05:36.294746 dv-cinder-797608-27-iscsi devstack@n-api.service[118237]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 16:05:37.545198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 16:05:37.547695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 16:05:38.382143 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 16:05:38.382143 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: from cryptography.utils import int_from_bytes Jun 02 16:05:38.382482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 16:05:38.382482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: from cryptography.utils import int_from_bytes Jun 02 16:05:38.382808 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 16:05:38.382808 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: from cryptography.utils import int_from_bytes Jun 02 16:05:38.383155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 16:05:38.383155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: from cryptography.utils import int_from_bytes Jun 02 16:05:40.960227 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 16:05:40.960923 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 16:05:40.961441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 16:05:40.962002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 16:05:40.962428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 16:05:40.963021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.963533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.964034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.964538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.965056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.965603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.966158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.966681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.967056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 16:05:40.967434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.967535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 16:05:40.967632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.968156 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.968295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 16:05:40.968708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-27-iscsi {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.968869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 16:05:40.969246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 16:05:40.969347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.969758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.969870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.970324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.970450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.970853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.970957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.971356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.971475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.971895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.971999 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.972402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.972512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.972923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.973274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.973446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.973960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.974067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.974429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.974542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.974961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.975068 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.975490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-27-iscsi {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.975606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.976015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.976129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.976515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.976630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.977027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.977135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.977541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.977652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.978046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.978237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.978600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.978699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.979108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.979250 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-27-iscsi {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.979760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.979990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.980293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.980502 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.980831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.981011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.982159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.982349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.982680 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.982861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.983208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.983330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.983750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.983855 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.984290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.984413 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.984813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.984907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.985348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.985453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.985928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.986043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.986494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.986617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-27-iscsi {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.987038 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.987156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.987556 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.987698 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.988080 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.988220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.988608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.988904 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.989149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.989421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.989664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.989939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.990208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.990508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.990673 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.991047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.991204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.991565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.991746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.992113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.992291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.992650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.992834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.993184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.993295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.993653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.993753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.994213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.994322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.994729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.994876 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.995238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.995346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.995755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.995868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.996266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.996372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.996773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.997442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.997719 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.997881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.998270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.998429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.998816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.998952 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.999362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.999466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:40.999900 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.000004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.000325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.000509 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.000743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.001054 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.001279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.001586 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.001821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.002154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.002367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.002834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.002927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.003265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.003357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.003794 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.003896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.004358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.004467 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.004877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.004981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.005391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.005493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.005909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.006023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.006468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.006575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.006988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.007099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.007506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.007606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.008021 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.008133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.008557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.008659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.009130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.009302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.009630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.009729 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.010099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.010262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.010596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.010703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.011120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.011220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.011666 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.011768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.012193 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.012296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.012770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.012876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.013289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.013398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.013791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.013896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.014334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.014442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.014856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.014955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.015377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.015475 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.015883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.015992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.016306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.016411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.016818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.016919 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.017336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.017451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.017872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.017975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.018416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.018540 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.018932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.019047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.019444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.019548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.019951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.020054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.020479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.020591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.020981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.021092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.021492 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.021606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.022007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.022142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.022551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.022653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.023055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.023159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.023571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.023666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.024087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.024181 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.024601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.024704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.025133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.025237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.025654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.025761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.026200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.026308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.026717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.026839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.027226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.027399 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.027740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.027847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.028306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.028403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.028825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.028967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.029341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.029444 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.029856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.029959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.030398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.030511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.030909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.031050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.031427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.031528 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.031934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.032026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.032446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.032552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.032954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.033053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.033459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.033562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.033975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.034141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.034522 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.034623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.035044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.035155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.035556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.035659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.036070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.036229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.036591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.036701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.037112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.037234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.037631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.037732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.038167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.038324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.038689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.038784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.039199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.039291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.039724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.039816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.040236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.040335 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.040753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.040853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.041268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.041414 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.041781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.041882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.042339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.042495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 16:05:41.042857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.042951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.043390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.043495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.044479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.044639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.045005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.045178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.045545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.045647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.046183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.046297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.046636 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.046748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.047159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.047273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.047683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.047789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.048229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.048331 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.048756 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.048866 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.049273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.049418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.049801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.049894 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.050368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.050483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.050895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.051025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.051441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.051543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.051971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.052063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.052494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.052634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.053019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.053124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.053542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.053634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.054090 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.054196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.054645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.054751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.055172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.055263 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.055694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.055793 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.056227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.056330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.056758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.056850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.057283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.057398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.057810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.057915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.058366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.058458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.058896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.058998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.060032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.060138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.060560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.060672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.061087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.061197 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.061630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.061725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.062192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.062289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.062724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.062821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.063251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.063358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.063767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.063872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.064282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.064382 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.064795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.064896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.065318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.065418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.065844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.065944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.066403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.066511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.066937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.067040 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.067459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.067582 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.067992 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.068090 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.068504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.068603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.069030 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.069131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.069554 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.069654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.070095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.070191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.070604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.070710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.071173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.071280 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.071648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.071747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.072165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.072272 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.072695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.072829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.073223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.073321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.073739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.073841 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.074298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.074436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.074827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.074953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.075424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.075598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.075960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.076129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.076499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.076655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.077034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.077175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.077572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.077686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.078126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.078252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.078687 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.078790 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.079221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.079325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.079752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.079864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.080267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.080359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.080805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.080897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.081315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.081421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.081831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.081931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.082391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.082485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.083168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.083287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.083680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.083780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.084199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.084298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.084717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.084823 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.085225 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.085317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.085737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.085827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.086286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.086383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.086801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.086905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.087318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.087434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.087832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.087937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.088352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.088452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.088877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.088969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.089431 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.089527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.089943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.090044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.090530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.090720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.091070 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.091224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.091598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.091728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.092190 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.092313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.092706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.092805 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.093221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.093342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.093739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.093847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.094282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.094391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.094797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.094898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.095306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.095409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.095831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.095925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.096355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.096456 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.096869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.096972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.097377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.097469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.097888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.098003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.098450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.098557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.098961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.099060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.099502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.099602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.100032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.100136 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.100559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.100660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.101077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.101218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.101602 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.101712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.102141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.102257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.102666 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.102763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.103201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.103314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.103723 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.103832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.104244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.104353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.104773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.104868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.105295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.105399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.105826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.105941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.107025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.107149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.107634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.107728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.108171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.108291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.108712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.108816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.109229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.109367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.109751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.109856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.110324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.110427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.110851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.110944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.111377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.111486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.111894 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.111998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.112418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.112519 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.112937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.113030 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.113459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.113565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.113986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.114099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.114550 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.114651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.115073 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.115164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.115597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.115699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.116122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.116222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.116647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.116748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.117160 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.117281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.117689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.117796 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.118229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.118326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.118747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.118862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.119259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.119382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.119779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.119874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.120306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.120415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.120833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.120931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.121348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.121443 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.122537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.122661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.123096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.123201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.123629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.123748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.124141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.124319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.124665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.124773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.125181 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.125284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.125695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.125791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.126249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.126358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.126787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.126886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.127305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.127403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.127817 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.127925 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.128334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.128431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.128855 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.128950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.129364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.129468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.129877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.129972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.130417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.130523 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.130945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.131044 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.131471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.131575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.131985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.132091 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.132510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.132626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.133039 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.133153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.133550 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.133646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.134061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.134177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.134612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.134718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.135135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.135232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.135654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.135751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.136169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.136275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.136684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.136780 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.137217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.137334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.137859 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.138232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.138426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.138754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.138962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.139295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.139516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.139846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.140049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.140374 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.140581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.140903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.141115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.141430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.141625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.141955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.142178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.142534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.142725 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.143065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.143599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.143732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.144135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.144232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.144676 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.144778 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.145207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.145312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.145735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.145838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.146291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.146400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.146819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.146920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.147351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.147511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.147887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.147993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.148401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.148518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.148916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.149016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.149429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.149528 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.149948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.150406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.150512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.150972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.151067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.151486 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.151594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.152003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.152142 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.152527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.152621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.153102 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.153462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.153670 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.154032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.154213 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.154613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.154722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.155191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.155293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.155714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.155831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.156226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.156320 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.156739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.156844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.157255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.157359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.157776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.157883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.158316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.158557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.158835 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.158945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.159347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.159441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.159874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.160033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.160391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.160500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.160911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.161004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.161427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.161556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.161950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.162052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.162500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.162598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.163015 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.163154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.163541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.163649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.164054 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.164155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.164576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.164684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.165088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.165189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.165596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.165695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.166136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.166274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.166655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.166801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.167187 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.167310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.167701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.167844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.168229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.168352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.169325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.169529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.169849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.170030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.170408 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.170673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.170928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.171193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.171462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.171739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.171990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.172255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.172510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.172774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.173011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.173286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.173545 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.173815 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.174100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.174364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.174610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.174880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.175140 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.175412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.175653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.175936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.176188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.176461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.176705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.176984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.177222 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.177499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.177744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.178023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.178306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.178577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.178830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.179105 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.179345 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.179630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.179895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.180141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.180425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.180652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.180941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.181179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.181461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.181702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.181990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.182242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.182538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.182769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.183053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.183282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.183585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.183815 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.184138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.184925 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.185290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.185549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.185818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.186066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.186373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.186619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.186892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.187142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.187414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.187722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.187944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.188273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.188450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.188794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.188963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.189411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.189534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.189938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.190055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.190481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.190620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.190992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.191100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.191508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.191620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.192031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.192133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.192546 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.192664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.193059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.193183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.193572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.193686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.194115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.194228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.194631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.194736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.195145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.195242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.195669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.195767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.196193 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.196291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.196701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.196797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.197210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.197316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.197726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.197825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.198270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.198370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.198784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.198893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.199316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.199409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.199835 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.199928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.200465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.200833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.200980 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.201360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.201501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.201878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.202051 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.202486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.202589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.203010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.203179 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.203606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.203749 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.204123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.204269 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.204650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.204803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.205163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.205316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.205682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.205839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.206237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.206337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.206767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.206866 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.207280 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.207375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.208060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.208177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.208575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.208690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.209098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.209203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.209610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.209703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.210145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.210260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.210732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.210847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.211191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.211304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.211713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.211815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.212240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.212337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.212759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.212859 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.213308 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.213466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.213821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.213919 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.214366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.214461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.214892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.215005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.215408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.215501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.215957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.216058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.216475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.216578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.217001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.217207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.217536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.217741 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.218086 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.218298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.218626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.218826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.219157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.219357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.219676 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.219889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.220204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.220428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.220734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.220964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.221253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.221482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.221802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.222234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.222362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.222769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.222863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.223307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.223409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.223864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.223972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.224344 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.224438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.224850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.224950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.225374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.225576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.225930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.226137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.226488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.226664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.227008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.227184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.227533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.227711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.228083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.228240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.228607 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.228779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.229170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.229322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.229814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.229906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.230371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.230548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.230896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.231076 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.232112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.232226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.232632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.232740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.233145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.233246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.233664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.233805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.234214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.234328 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.234767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.234861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.235285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.235397 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.235801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.235895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.236313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.236406 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.236857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.236966 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.237373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.237468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.237898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.237991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.238468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.238710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.238993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.239168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.239548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.239695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.240108 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.240402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.240650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.240930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.241203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.241461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.241912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.242014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.242488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.242626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.243023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.243117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.243559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.243660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.244090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.244226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.244601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.244709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.245117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.245218 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.245644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.245736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.246186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.246296 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.246704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.246960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.247371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.247466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.247897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.248000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.248432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.248526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.248973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.249105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.249498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.249636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.250017 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.250244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.250568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.250821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.251116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.251326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.251636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.251867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.252184 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.252415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.252723 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.252932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.253271 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.253452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.253827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.253981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.254377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.254533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.254930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.255057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.255460 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.255607 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.255983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.256124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.256508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.256654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.257025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.257177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.257606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.257708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.258153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.258252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.258696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.258805 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.259234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.259341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.259757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.259897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.260266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.260372 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.260799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.260893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.261341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.261449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.261868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.261976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.262945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.263054 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.263485 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.263579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.263998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.264092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.264514 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.264621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.265026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.265147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.265539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.265662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.266063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.266262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.266612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.266718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.267145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.267242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.267653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.267754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.268170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.268270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.268685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.268788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.269227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.269330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.269745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.269847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.270297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.270407 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.270822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.270923 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.271355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.271508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.271856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.271956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.272373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.272486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.272901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.273004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.273414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.273510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.273934 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.274035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.274478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.274697 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.275000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.275103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.275521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.275620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.276033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.276136 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.276545 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.276645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.277071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.277163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.277585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.277677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.278230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.278343 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.278762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.278870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.279281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.279375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.279799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.279892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.280312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.280405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.280841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.280936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.281359 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.281453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.281889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.282009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.282444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.282558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.282981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.283384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.283528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.283925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.284054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.284469 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.284604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.285006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.285139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.285547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.285684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.286095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.286245 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.286635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.286774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.287170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.287313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.287701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.287848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.288232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.288382 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.288763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.288988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.289320 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.289471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.289882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.289994 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.290451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.290685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.291020 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.291565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.291649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.292092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.292174 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.292624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.292728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.293149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.293246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.293824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.294106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.295174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.295365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.295494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.295626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.295743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.295848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.295991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.296221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.296536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.296715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.297068 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.297246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.297602 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.297800 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.298165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.298373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.298703 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.298923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.299235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.299493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.299765 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.300027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.300299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.300559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.300833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.301095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.301377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.301626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.301941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.302254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.302536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.302790 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.303069 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.303314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.303604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.303848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.304143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.304381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.304917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.305018 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.305540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.305643 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.306122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.306265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.306620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.306727 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.307147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.307239 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.307668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.307769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.308184 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.308278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.308709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.308811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.309225 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.309889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.310320 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.310427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.310846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.310960 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.311372 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.311465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.311888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.311980 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.312416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.312521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.312943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.313035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.313462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.313804 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.314009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.314376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.314574 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.314930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.315482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.315603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.316036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.316143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.316568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.316661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.317099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.317204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.317639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.317763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.318192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.318335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.318708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.318840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.319232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.319362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.319748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.319879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.320263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.320402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.320783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.320905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.321359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.321551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.321805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.321970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.322361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.322526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.322906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.323089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.323438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.323891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.324397 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.324482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.324568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.325614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.326234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.326428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.326765 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.326868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.327287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.327392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.327808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.327918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.328326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.328419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.328845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.328939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.329361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.329463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.329875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.329968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.330423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.330516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.330951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.331053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.331471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.331580 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.331985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.332084 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.332498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.332599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.333265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.333364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.333777 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.333869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.334330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.334426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.334853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.335027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.335405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.335523 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.335925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.336025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.336441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.336648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.337487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.337662 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.337823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.337980 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.338193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.338368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.338541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.338718 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.339008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.339417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.339587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.339752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.340047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.340210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.340652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.341060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.341238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.341583 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.341681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.342134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.342257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.342667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.342788 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.343200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.343343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.343709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.343818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.344229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.344333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.344743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.344844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.345263 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.345370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.345790 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.345927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.346401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.346509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.346933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.347027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.347457 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.347550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.347981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.348076 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.348515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.348616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.349036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.349130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.349562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.349982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.350109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.350581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.350748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.351106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.351209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.351637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.351786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.352159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.352263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.352678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.352779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.353197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.353292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.353712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.353819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.354274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.354389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.354798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.354894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.355321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.355421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.355838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.355930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.356424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.356536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.356950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.357058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.357462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.357599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.357990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.358146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.358555 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.358685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.359073 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.359209 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.359586 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.359718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.360112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.360314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.360647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.360853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.361176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.361394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.361721 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.361944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.362589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.363178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.363327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.363754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.363969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.364304 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.364673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.364865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.365313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.365489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.365872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.366046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.366448 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.366559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.366977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.367082 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.367491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.367595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.368005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.368108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.368517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.368693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.369039 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.369224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.369558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.369656 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.370139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.370327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.370615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.370853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.371139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.371385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.371658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.372471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.372947 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.373319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.373496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.373849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.374028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.374399 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.374602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.374922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.375154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.375470 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.375702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.375966 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.376315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.376512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.376847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.377017 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.377420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.377604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.378006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.378148 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.378553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.378657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.379078 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.379182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.379594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.379696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.380106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.380198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.380614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.380717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.381126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.381226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.381640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.381742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.382191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.382301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.382716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.382859 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.383236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.383343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.383785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.383892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.384298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.384405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.384814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.384913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.385329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.385426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.385841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.385948 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.386392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.386491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.386905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.387011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.388047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.388385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.388655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.388915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.389188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.389439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.389722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.389959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.390285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.390521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.390821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.391031 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.391349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.391678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.391885 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.392199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.392440 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.392714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.392992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.393233 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.393514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.393745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.394063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.394341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.394631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.394902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.395178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.395439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.395779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.395982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.396240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.396512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.396803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.397057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.397326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.397591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.397855 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.398154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.398425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.398698 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.398953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.399229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.399484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.399752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.400021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.400308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.400567 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.400851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.401115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.401377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.401664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.401919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.402219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.402470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.402777 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.403020 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.403389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.403759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.403998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.404310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.404531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.404860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.405167 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.405389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.405956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.406531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.406653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.407085 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.407194 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.407450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.407663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.407773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.408056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 16:05:41.408236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.408763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.409218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.409615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.410018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.410440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.410837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.411239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.411637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.412046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.412460 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.412849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.413257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.413659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.414099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.414504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.414925 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.415327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.415846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.416412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.416803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 16:05:41.417131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 16:05:41.473129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO dbcounter [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Registered counter for database nova_api Jun 02 16:05:41.478431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO dbcounter [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Registered counter for database nova_api Jun 02 16:05:41.495334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_db.sqlalchemy.engines [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 16:05:41.499581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_db.sqlalchemy.engines [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 16:05:41.504988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writer thread running {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 16:05:41.506486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writer thread running {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 16:05:41.565891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.context [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dabfd63-010b-4913-be80-9c36dccab098(cell1) {{(pid=118256) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 16:05:41.570253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:05:41.577810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:05:41.577810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:05:41.578044 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.context [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dabfd63-010b-4913-be80-9c36dccab098(cell1) {{(pid=118257) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 16:05:41.578152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:05:41.578152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO dbcounter [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Registered counter for database nova_cell0 Jun 02 16:05:41.578580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:05:41.580323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:05:41.581357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:05:41.581565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO dbcounter [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Registered counter for database nova_cell1 Jun 02 16:05:41.583670 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:05:41.585689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO dbcounter [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Registered counter for database nova_cell0 Jun 02 16:05:41.589312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_db.sqlalchemy.engines [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 16:05:41.590323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO dbcounter [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Registered counter for database nova_cell1 Jun 02 16:05:41.592004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_db.sqlalchemy.engines [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 16:05:41.597824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_db.sqlalchemy.engines [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 16:05:41.600297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_db.sqlalchemy.engines [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 16:05:41.604608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writer thread running {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 16:05:41.605895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writer thread running {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 16:05:41.607844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writer thread running {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 16:05:41.609142 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writer thread running {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 16:05:41.759438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO dbcounter [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Registered counter for database nova_cell0 Jun 02 16:05:41.766938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_db.sqlalchemy.engines [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 16:05:41.772099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writer thread running {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 16:05:41.773319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO dbcounter [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Registered counter for database nova_cell0 Jun 02 16:05:41.780870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_db.sqlalchemy.engines [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 16:05:41.788993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writer thread running {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 16:05:42.234902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: WARNING keystonemiddleware.auth_token [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 16:05:42.242201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: WARNING keystonemiddleware.auth_token [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 16:05:42.255651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: WARNING keystonemiddleware.auth_token [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 16:05:42.263271 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: WARNING keystonemiddleware.auth_token [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 16:05:42.467949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: WARNING keystonemiddleware.auth_token [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 16:05:42.473967 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: WARNING keystonemiddleware.auth_token [None req-91886b2f-ed1d-4279-ad72-9eb1f15cb0c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 16:05:42.479062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9edbcd9c0 pid: 118257 (default app) Jun 02 16:05:42.493113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: WARNING keystonemiddleware.auth_token [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 16:05:42.499997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: WARNING keystonemiddleware.auth_token [None req-3e9a0b4e-6941-4404-b956-4724ce08ccb3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 16:05:42.505058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9edbcd9c0 pid: 118256 (default app) Jun 02 16:06:25.338222 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.339132 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.340598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.341545 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.561318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=3 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.563083 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=3 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.563869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=3 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.564601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=3 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:26.602543 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-239bf0fb-f57d-4afa-a00c-84cd7a78c2bf tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Action: 'create', calling method: .version_select at 0x7f2d5daf4310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-903364678", "metadata": {"Type": "work"}}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:26.791210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ab1ea31f-7e66-41a4-85a5-46d34786aa23 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Action: 'create', calling method: .version_select at 0x7f2d5daf2310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-15912134", "metadata": {"Type": "work"}}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ab1ea31f-7e66-41a4-85a5-46d34786aa23 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Request method failure captured: Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 120 Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOABOeGVCOmwxvAXkLk13MncuItYSSDWnD2Q3ciMCRvGtyBQ11Qv20TuuHusurHBJipeXFFsT9NUUy0joN7rAQ1GhcRK2ioAJuZUvIRAb5grnFAPN2k0T1EXgBvKaVrWhnd2y-I58Fts8NuRysD1XvYf1c2_bq7eCioQWAsAQEz2J7M Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:06:26.830515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9cb3beab857d4900b872254c16ddab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}] Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: af0e4caac85b419590b35b3d0faf875e Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-15912134", "metadata": {"Type": "work"}}} Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: Jun 02 16:06:26.832575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-15912134', 'metadata': {'Type': 'work'}}}} Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise error Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi '#$%' Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:06:26.833556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 16:06:26.835177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 16:06:26.836557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 16:06:26.836557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.837784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ab1ea31f-7e66-41a4-85a5-46d34786aa23 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:06:26.839369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ab1ea31f-7e66-41a4-85a5-46d34786aa23 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.288130 Jun 02 16:06:26.840457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jun 2 16:06:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1291 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:06:26.851115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5c41e6f1-5fea-4b23-9dfc-e64369b63c1b tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Action: 'create', calling method: .version_select at 0x7f2d5d98c700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-361956112", "metadata": {"Type": "work"}}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5c41e6f1-5fea-4b23-9dfc-e64369b63c1b tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Request method failure captured: Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 119 Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOABOeGVCOmwxvAXkLk13MncuItYSSDWnD2Q3ciMCRvGtyBQ11Qv20TuuHusurHBJipeXFFsT9NUUy0joN7rAQ1GhcRK2ioAJuZUvIRAb5grnFAPN2k0T1EXgBvKaVrWhnd2y-I58Fts8NuRysD1XvYf1c2_bq7eCioQWAsAQEz2J7M Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:06:26.855486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9cb3beab857d4900b872254c16ddab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}] Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: af0e4caac85b419590b35b3d0faf875e Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-361956112", "metadata": {"Type": "work"}}} Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: Jun 02 16:06:26.867932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-361956112', 'metadata': {'Type': 'work'}}}} Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise error Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi '0' Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:06:26.869632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 16:06:26.871639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 16:06:26.872936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 16:06:26.872936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.872936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5c41e6f1-5fea-4b23-9dfc-e64369b63c1b tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:06:26.872936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5c41e6f1-5fea-4b23-9dfc-e64369b63c1b tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013215 Jun 02 16:06:26.872936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 2/2] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jun 2 16:06:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:06:26.887613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2f47e08c-51a9-4ae9-96f3-a5a7b4ff55da tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Action: 'create', calling method: .version_select at 0x7f2d5daf2670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1424079756", "metadata": {"Type": "work"}}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2f47e08c-51a9-4ae9-96f3-a5a7b4ff55da tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Request method failure captured: Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 119 Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOABOeGVCOmwxvAXkLk13MncuItYSSDWnD2Q3ciMCRvGtyBQ11Qv20TuuHusurHBJipeXFFsT9NUUy0joN7rAQ1GhcRK2ioAJuZUvIRAb5grnFAPN2k0T1EXgBvKaVrWhnd2y-I58Fts8NuRysD1XvYf1c2_bq7eCioQWAsAQEz2J7M Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:06:26.893723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9cb3beab857d4900b872254c16ddab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}] Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: af0e4caac85b419590b35b3d0faf875e Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1424079756", "metadata": {"Type": "work"}}} Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: Jun 02 16:06:26.904427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1424079756', 'metadata': {'Type': 'work'}}}} Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise error Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi '' Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:06:26.905337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 16:06:26.906746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 16:06:26.907967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 16:06:26.907967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:26.907967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2f47e08c-51a9-4ae9-96f3-a5a7b4ff55da tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:06:26.907967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2f47e08c-51a9-4ae9-96f3-a5a7b4ff55da tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019699 Jun 02 16:06:26.907967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 3/3] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jun 2 16:06:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:06:26.920336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b0f7215c-0e5f-4793-820b-22d2adde0791 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Calling method '.version_select at 0x7f2d5d9a23a0>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:27.501689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-b0f7215c-0e5f-4793-820b-22d2adde0791 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] HTTP exception thrown: Volume tempest-invalid-682527703 could not be found. Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b0f7215c-0e5f-4793-820b-22d2adde0791 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Request method failure captured: Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-682527703 HTTP/1.1 Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOABOeGVCOmwxvAXkLk13MncuItYSSDWnD2Q3ciMCRvGtyBQ11Qv20TuuHusurHBJipeXFFsT9NUUy0joN7rAQ1GhcRK2ioAJuZUvIRAb5grnFAPN2k0T1EXgBvKaVrWhnd2y-I58Fts8NuRysD1XvYf1c2_bq7eCioQWAsAQEz2J7M Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:06:27.507479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9cb3beab857d4900b872254c16ddab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}] Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: af0e4caac85b419590b35b3d0faf875e Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Volume tempest-invalid-682527703 could not be found. Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': 'tempest-invalid-682527703'} Jun 02 16:06:27.509029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-682527703 could not be found. (HTTP 404) (Request-ID: req-c5ebae25-67fb-4ae2-afc2-b0aa8b215222) Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:27.511219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 16:06:27.512612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-682527703 could not be found. Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:06:27.514056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-682527703 could not be found. Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-682527703 could not be found. Jun 02 16:06:27.515706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.521011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b0f7215c-0e5f-4793-820b-22d2adde0791 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Returning 404 to user: Volume tempest-invalid-682527703 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:06:27.522702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b0f7215c-0e5f-4793-820b-22d2adde0791 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-682527703" status: 404 len: 98 microversion: 2.1 time: 0.613294 Jun 02 16:06:27.529627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 4/4] 10.222.0.59 () {58 vars in 1214 bytes} [Thu Jun 2 16:06:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-682527703 => generated 98 bytes in 617 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 02 16:06:27.537564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c9478ce0-f840-422b-a8e1-4fa369a500c5 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005507 Jun 02 16:06:27.539147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 5/5] 10.222.0.59 () {58 vars in 1139 bytes} [Thu Jun 2 16:06:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 16:06:27.552438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-af82d7aa-c95c-44a1-8a08-716e23914a40 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005833 Jun 02 16:06:27.553846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 6/6] 10.222.0.59 () {58 vars in 1136 bytes} [Thu Jun 2 16:06:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 02 16:06:27.570560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d922997c-2496-4e68-b7bc-42bbc75882b7 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Calling method '.version_select at 0x7f2d5d9498b0>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:27.779890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-d922997c-2496-4e68-b7bc-42bbc75882b7 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] HTTP exception thrown: Volume 33b7071a-643a-4af8-8768-a5bdf59a3245 could not be found. Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d922997c-2496-4e68-b7bc-42bbc75882b7 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Request method failure captured: Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: DELETE /compute/v2.1/os-volumes/33b7071a-643a-4af8-8768-a5bdf59a3245 HTTP/1.1 Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOABOeGVCOmwxvAXkLk13MncuItYSSDWnD2Q3ciMCRvGtyBQ11Qv20TuuHusurHBJipeXFFsT9NUUy0joN7rAQ1GhcRK2ioAJuZUvIRAb5grnFAPN2k0T1EXgBvKaVrWhnd2y-I58Fts8NuRysD1XvYf1c2_bq7eCioQWAsAQEz2J7M Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:06:27.782155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9cb3beab857d4900b872254c16ddab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}] Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: af0e4caac85b419590b35b3d0faf875e Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Volume 33b7071a-643a-4af8-8768-a5bdf59a3245 could not be found. Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '33b7071a-643a-4af8-8768-a5bdf59a3245'} Jun 02 16:06:27.783462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 33b7071a-643a-4af8-8768-a5bdf59a3245 could not be found. (HTTP 404) (Request-ID: req-ccc9bcb1-e21d-4fe7-a125-6f75ec94cf55) Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:27.784216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 16:06:27.785435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 33b7071a-643a-4af8-8768-a5bdf59a3245 could not be found. Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 16:06:27.786529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 33b7071a-643a-4af8-8768-a5bdf59a3245 could not be found. Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 33b7071a-643a-4af8-8768-a5bdf59a3245 could not be found. Jun 02 16:06:27.788483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:27.792212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d922997c-2496-4e68-b7bc-42bbc75882b7 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Returning 404 to user: Volume 33b7071a-643a-4af8-8768-a5bdf59a3245 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:06:27.793736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d922997c-2496-4e68-b7bc-42bbc75882b7 tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/33b7071a-643a-4af8-8768-a5bdf59a3245" status: 404 len: 109 microversion: 2.1 time: 0.233937 Jun 02 16:06:27.794698 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 7/7] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 2 16:06:27 2022] DELETE /compute/v2.1/os-volumes/33b7071a-643a-4af8-8768-a5bdf59a3245 => generated 109 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:06:27.805330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1d2c161d-74f6-4a0f-b141-9fe41d0805ef tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Calling method '.version_select at 0x7f2d5d949310>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:28.217111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-239bf0fb-f57d-4afa-a00c-84cd7a78c2bf tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.539926 Jun 02 16:06:28.217111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1/8] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jun 2 16:06:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2543 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 02 16:06:28.217111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0782e2ad-c93d-4035-ae50-f6912912c02b tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Calling method '.version_select at 0x7f2d5d9ba310>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-1d2c161d-74f6-4a0f-b141-9fe41d0805ef tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] HTTP exception thrown: Volume 16a5313a-e0af-4979-bbcc-96903589d18f could not be found. Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1d2c161d-74f6-4a0f-b141-9fe41d0805ef tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Request method failure captured: Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/os-volumes/16a5313a-e0af-4979-bbcc-96903589d18f HTTP/1.1 Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOABOeGVCOmwxvAXkLk13MncuItYSSDWnD2Q3ciMCRvGtyBQ11Qv20TuuHusurHBJipeXFFsT9NUUy0joN7rAQ1GhcRK2ioAJuZUvIRAb5grnFAPN2k0T1EXgBvKaVrWhnd2y-I58Fts8NuRysD1XvYf1c2_bq7eCioQWAsAQEz2J7M Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:06:28.223237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9cb3beab857d4900b872254c16ddab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9cb3beab857d4900b872254c16ddab56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9cb3beab857d4900b872254c16ddab56"}]}] Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 9cb3beab857d4900b872254c16ddab56 Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesNegativeTest-460832584 Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: af0e4caac85b419590b35b3d0faf875e Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesNegativeTest-460832584-project Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Volume 16a5313a-e0af-4979-bbcc-96903589d18f could not be found. Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '16a5313a-e0af-4979-bbcc-96903589d18f'} Jun 02 16:06:28.230355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16a5313a-e0af-4979-bbcc-96903589d18f could not be found. (HTTP 404) (Request-ID: req-87934a0c-5047-4eb7-b08a-5c2d7d0f3183) Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:28.232902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:06:28.238370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16a5313a-e0af-4979-bbcc-96903589d18f could not be found. Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 16:06:28.241882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16a5313a-e0af-4979-bbcc-96903589d18f could not be found. Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16a5313a-e0af-4979-bbcc-96903589d18f could not be found. Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1d2c161d-74f6-4a0f-b141-9fe41d0805ef tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] Returning 404 to user: Volume 16a5313a-e0af-4979-bbcc-96903589d18f could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1d2c161d-74f6-4a0f-b141-9fe41d0805ef tempest-VolumesNegativeTest-460832584 tempest-VolumesNegativeTest-460832584-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/16a5313a-e0af-4979-bbcc-96903589d18f" status: 404 len: 109 microversion: 2.1 time: 0.145788 Jun 02 16:06:28.244995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 8/9] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:27 2022] GET /compute/v2.1/os-volumes/16a5313a-e0af-4979-bbcc-96903589d18f => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 16:06:28.247275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0782e2ad-c93d-4035-ae50-f6912912c02b tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d" status: 200 len: 352 microversion: 2.1 time: 0.116458 Jun 02 16:06:28.247275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 2/10] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:27 2022] GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:28.615559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1081805737", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "networks": [{"uuid": "0ca97231-91b4-4714-a1a2-69d8e38fa922"}]}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:28.740876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.network.neutron [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] validate_networks() for [('0ca97231-91b4-4714-a1a2-69d8e38fa922', None, None, None, None, None)] {{(pid=118256) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:06:28.863887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5bfe9203-e218-4723-b1e3-fa4451e22fed tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5d9ba4c0>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:28.946716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5bfe9203-e218-4723-b1e3-fa4451e22fed tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/30ad664d-0d2f-4eef-8dbc-fc150b3660d3" status: 200 len: 350 microversion: 2.1 time: 0.086617 Jun 02 16:06:28.953557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 3/11] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:28 2022] GET /compute/v2.1/os-volumes/30ad664d-0d2f-4eef-8dbc-fc150b3660d3 => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:06:29.022204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2eb6834f-3665-426c-9f4d-c2725db07825 tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Calling method '.version_select at 0x7f2d5d9baaf0>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:29.143361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2eb6834f-3665-426c-9f4d-c2725db07825 tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d" status: 200 len: 352 microversion: 2.1 time: 0.125371 Jun 02 16:06:29.143940 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 4/12] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:29 2022] GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:06:30.165245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-384ceab2-e07d-47e5-a77a-b2dbd285e5ad tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Calling method '.version_select at 0x7f2d5d9511f0>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:30.264113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-384ceab2-e07d-47e5-a77a-b2dbd285e5ad tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d" status: 200 len: 353 microversion: 2.1 time: 0.110541 Jun 02 16:06:30.273334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 5/13] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:30 2022] GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:30.281848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e27fd6a2-7fe1-4909-8f2c-ca9c6d851508 tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Calling method '.version_select at 0x7f2d5d9bac10>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:30.359105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e27fd6a2-7fe1-4909-8f2c-ca9c6d851508 tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d" status: 200 len: 353 microversion: 2.1 time: 0.082862 Jun 02 16:06:30.359654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 6/14] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:30 2022] GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:30.384748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-89ba7566-8516-4735-b683-3228392527fb tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Calling method '.version_select at 0x7f2d5d9ba280>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:30.490694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Flavor limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:06:30.491205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Image limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:06:30.491768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Flavor pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:06:30.492537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Image pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:06:30.494102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:06:30.513956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:30.516482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:30.516482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:30.516482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:30.556874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Getting quotas for project 8e72d608f9b243739572bf4fab56bd13. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:06:30.563829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Getting quotas for user 1400263107254337be69dc15e8d046d4 and project 8e72d608f9b243739572bf4fab56bd13. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:06:30.578016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Going to run 1 instances... {{(pid=118256) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:06:30.581255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:06:30.742029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-89ba7566-8516-4735-b683-3228392527fb tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d" status: 202 len: 0 microversion: 2.1 time: 0.368356 Jun 02 16:06:30.746062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 7/15] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 2 16:06:30 2022] DELETE /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:06:30.751578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-094b1f8d-4f42-4247-9fff-8cc004b49b0b tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Calling method '.version_select at 0x7f2d5d951430>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:30.836247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5399d288-e3d6-4408-8a60-2f490b8e66a4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.318748 Jun 02 16:06:30.842044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 9/16] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:06:30.849832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1bb30d72-632d-4988-89b3-61b4b3dfb39a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:30.850752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1bb30d72-632d-4988-89b3-61b4b3dfb39a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:30.880546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-094b1f8d-4f42-4247-9fff-8cc004b49b0b tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d" status: 200 len: 352 microversion: 2.1 time: 0.128351 Jun 02 16:06:30.881887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 8/17] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:30 2022] GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:31.093844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1bb30d72-632d-4988-89b3-61b4b3dfb39a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:31.128048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1bb30d72-632d-4988-89b3-61b4b3dfb39a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1215 microversion: 2.1 time: 0.283514 Jun 02 16:06:31.128958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 10/18] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:30 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:06:31.890530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-874f3b9e-b2be-4eb7-b42b-3a8ef097ee34 tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Calling method '.version_select at 0x7f2d5d9ba1f0>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:31.944926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-874f3b9e-b2be-4eb7-b42b-3a8ef097ee34 tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] HTTP exception thrown: Volume f3e5d059-e26e-472f-8e92-0fb428b87f9d could not be found. Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-874f3b9e-b2be-4eb7-b42b-3a8ef097ee34 tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Request method failure captured: Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d HTTP/1.1 Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOABbC_MmmbjZdcrsNKH6qBceG7OqJVeboB6SZ5MKTXooI4XQzOTneFwqEgDG1WhsgR9RgUQYMRi02uSy3rLduZeoN8dG3C_qkxHsgvaistI9oC_At1fF2Sq3Y1bFhi-8DqpIUxGY0IWcSKQft2yyhKS-OYoUo5mJhgGqUSpq5RpGos Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 6721049c26e34cfbb1021c3832087d68 Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-VolumesGetTestJSON-634858683 Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:06:31.949347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6721049c26e34cfbb1021c3832087d68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6721049c26e34cfbb1021c3832087d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6721049c26e34cfbb1021c3832087d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6721049c26e34cfbb1021c3832087d68"}]}] Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-VolumesGetTestJSON-634858683 Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 6721049c26e34cfbb1021c3832087d68 Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-VolumesGetTestJSON-634858683 Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-VolumesGetTestJSON-634858683-project Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 7f57f8293f6d43388c824a9bc5c57da9 Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-VolumesGetTestJSON-634858683-project Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Volume f3e5d059-e26e-472f-8e92-0fb428b87f9d could not be found. Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': 'f3e5d059-e26e-472f-8e92-0fb428b87f9d'} Jun 02 16:06:31.950402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f3e5d059-e26e-472f-8e92-0fb428b87f9d could not be found. (HTTP 404) (Request-ID: req-2f6ed29f-46f9-44fc-8dde-5faab0b8b371) Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:31.951019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:06:31.951854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f3e5d059-e26e-472f-8e92-0fb428b87f9d could not be found. Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 16:06:31.956513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f3e5d059-e26e-472f-8e92-0fb428b87f9d could not be found. Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f3e5d059-e26e-472f-8e92-0fb428b87f9d could not be found. Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-874f3b9e-b2be-4eb7-b42b-3a8ef097ee34 tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] Returning 404 to user: Volume f3e5d059-e26e-472f-8e92-0fb428b87f9d could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-874f3b9e-b2be-4eb7-b42b-3a8ef097ee34 tempest-VolumesGetTestJSON-634858683 tempest-VolumesGetTestJSON-634858683-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d" status: 404 len: 109 microversion: 2.1 time: 0.065335 Jun 02 16:06:31.957790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 9/19] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:31 2022] GET /compute/v2.1/os-volumes/f3e5d059-e26e-472f-8e92-0fb428b87f9d => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:06:32.147343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e241028f-3317-470a-9253-589cb484ae99 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:32.148629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e241028f-3317-470a-9253-589cb484ae99 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:32.247179 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4807bbbb-0599-44be-bf6b-da78d91b4c59 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5e330550>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:32.250199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e241028f-3317-470a-9253-589cb484ae99 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:32.261562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e241028f-3317-470a-9253-589cb484ae99 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1215 microversion: 2.1 time: 0.119552 Jun 02 16:06:32.271611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 11/20] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:32 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:32.329400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4807bbbb-0599-44be-bf6b-da78d91b4c59 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/5becafbd-0743-4f20-ab2d-fa3e57ca0763" status: 200 len: 351 microversion: 2.1 time: 0.087479 Jun 02 16:06:32.330003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 10/21] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:32 2022] GET /compute/v2.1/os-volumes/5becafbd-0743-4f20-ab2d-fa3e57ca0763 => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:06:33.287085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b22ffc75-5803-4357-93ef-045dbec04caf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:33.288210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b22ffc75-5803-4357-93ef-045dbec04caf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:33.695774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b22ffc75-5803-4357-93ef-045dbec04caf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:33.721625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b22ffc75-5803-4357-93ef-045dbec04caf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1215 microversion: 2.1 time: 0.443221 Jun 02 16:06:33.732957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 12/22] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:33 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1215 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:34.736249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3339ace9-aab3-45b4-a4ef-1f9681ea6cfa tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:34.736998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3339ace9-aab3-45b4-a4ef-1f9681ea6cfa tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:34.780038 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3339ace9-aab3-45b4-a4ef-1f9681ea6cfa tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:34.782624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3339ace9-aab3-45b4-a4ef-1f9681ea6cfa tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:34.787640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3339ace9-aab3-45b4-a4ef-1f9681ea6cfa tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:34.788176 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3339ace9-aab3-45b4-a4ef-1f9681ea6cfa tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:35.269795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3339ace9-aab3-45b4-a4ef-1f9681ea6cfa tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:35.296775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3339ace9-aab3-45b4-a4ef-1f9681ea6cfa tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1211 microversion: 2.1 time: 0.564606 Jun 02 16:06:35.303638 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:34 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1211 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:35.578931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c3f9e992-e59f-4735-9378-c41e8aab5b53 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5cff3b80>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:35.730804 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c3f9e992-e59f-4735-9378-c41e8aab5b53 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/086aae9e-9fed-4ecb-9883-51991b5ca128" status: 200 len: 351 microversion: 2.1 time: 0.155673 Jun 02 16:06:35.737495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 13/24] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:06:35 2022] GET /compute/v2.1/os-volumes/086aae9e-9fed-4ecb-9883-51991b5ca128 => generated 351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:35.748635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cb15f0ff-63eb-4995-8862-61dcbab2f7b7 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5d8c1f70>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:35.966144 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cb15f0ff-63eb-4995-8862-61dcbab2f7b7 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.226798 Jun 02 16:06:35.966880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 12/25] 10.222.0.59 () {58 vars in 1133 bytes} [Thu Jun 2 16:06:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:35.981072 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0346e4a8-9072-4a7e-8ccf-238d0d91b615 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5cff31f0>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:36.266780 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0346e4a8-9072-4a7e-8ccf-238d0d91b615 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.290810 Jun 02 16:06:36.267348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 14/26] 10.222.0.59 () {58 vars in 1148 bytes} [Thu Jun 2 16:06:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:36.279708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a9878202-e422-461f-9f16-6f76581c0941 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5d820310>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:36.324279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e53dc7f4-37e9-4bea-8e55-82a178f4af8b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:36.325153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e53dc7f4-37e9-4bea-8e55-82a178f4af8b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:36.344958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e53dc7f4-37e9-4bea-8e55-82a178f4af8b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:36.345625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e53dc7f4-37e9-4bea-8e55-82a178f4af8b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:36.346972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e53dc7f4-37e9-4bea-8e55-82a178f4af8b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:36.347545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e53dc7f4-37e9-4bea-8e55-82a178f4af8b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:36.560059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a9878202-e422-461f-9f16-6f76581c0941 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.284453 Jun 02 16:06:36.570696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 13/27] 10.222.0.59 () {58 vars in 1133 bytes} [Thu Jun 2 16:06:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:36.576210 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8811d4d1-23fd-4409-a7c3-fcf335471ace tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5d820f70>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:36.826385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8811d4d1-23fd-4409-a7c3-fcf335471ace tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.253874 Jun 02 16:06:36.830288 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 14/28] 10.222.0.59 () {58 vars in 1166 bytes} [Thu Jun 2 16:06:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:36.847712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-190bb5e1-6211-4382-8de1-95fa9d08dc4d tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5d820430>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:36.888762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e53dc7f4-37e9-4bea-8e55-82a178f4af8b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:36.914834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e53dc7f4-37e9-4bea-8e55-82a178f4af8b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1285 microversion: 2.1 time: 0.597237 Jun 02 16:06:36.918115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 15/29] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:36 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1285 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:37.064252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-190bb5e1-6211-4382-8de1-95fa9d08dc4d tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.220469 Jun 02 16:06:37.074482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 15/30] 10.222.0.59 () {58 vars in 1169 bytes} [Thu Jun 2 16:06:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:37.082915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e10b01d0-1056-4feb-833a-f5a187509f42 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5c72c5e0>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:37.267571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e10b01d0-1056-4feb-833a-f5a187509f42 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.193888 Jun 02 16:06:37.268307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 16/31] 10.222.0.59 () {58 vars in 1154 bytes} [Thu Jun 2 16:06:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:37.282635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0266ad5e-0749-4683-a8af-03b69b585815 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5d87b820>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:37.468105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0266ad5e-0749-4683-a8af-03b69b585815 tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.191358 Jun 02 16:06:37.469346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 16/32] 10.222.0.59 () {58 vars in 1187 bytes} [Thu Jun 2 16:06:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:37.482132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5c347a7c-a267-45a0-83c2-3c607bd913fb tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] Calling method '.version_select at 0x7f2d5c739e50>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:37.662419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5c347a7c-a267-45a0-83c2-3c607bd913fb tempest-VolumesTestJSON-218557155 tempest-VolumesTestJSON-218557155-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.185035 Jun 02 16:06:37.663244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 17/33] 10.222.0.59 () {58 vars in 1154 bytes} [Thu Jun 2 16:06:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:06:37.947944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8ad2f4da-8bc2-430b-8a63-ee6d41243c93 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:37.949390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8ad2f4da-8bc2-430b-8a63-ee6d41243c93 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:37.963961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ad2f4da-8bc2-430b-8a63-ee6d41243c93 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:37.965795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ad2f4da-8bc2-430b-8a63-ee6d41243c93 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:37.967529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ad2f4da-8bc2-430b-8a63-ee6d41243c93 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:37.968228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ad2f4da-8bc2-430b-8a63-ee6d41243c93 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:38.302120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8ad2f4da-8bc2-430b-8a63-ee6d41243c93 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:38.316738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8ad2f4da-8bc2-430b-8a63-ee6d41243c93 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1273 microversion: 2.1 time: 0.382305 Jun 02 16:06:38.317315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 17/34] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:37 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1273 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:39.851318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1a233e00-647a-4628-9275-b7dff16105da tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'create', calling method: .version_select at 0x7f2d5d826dc0>, body: {"keypair": {"name": "tempest-keypair-909666240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqI0IsnBbgy5Got8zdLJh0cyp2V7Z14+B6J87xAjGyDQoFGA4Ymr805YeVqPhHDV/77xYFKKs1+mm5PH4Kjp+3DfwzpoKo10WU0B+S8ZRZkCshRrwTnoutO16tFYoccEg=="}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:39.897083 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2046022867", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:39.963816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-1a233e00-647a-4628-9275-b7dff16105da tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Getting quotas for project 9598d078f4a1477babe0eaf804ef54a8. Resources: {'key_pairs'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:06:39.982569 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-1a233e00-647a-4628-9275-b7dff16105da tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Getting quotas for user 88bb3d2dbcdb45bb8baba424e5239e21 and project 9598d078f4a1477babe0eaf804ef54a8. Resources: {'key_pairs'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:06:40.027012 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.network.neutron [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] validate_networks() for [('57598317-0238-4159-9273-26c98b610fc0', None, None, None, None, None)] {{(pid=118256) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:06:40.253612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1a233e00-647a-4628-9275-b7dff16105da tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.079396 Jun 02 16:06:40.258289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 18/35] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 2 16:06:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:40.263061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f8809355-44bf-4b66-8231-92b86d1c9394 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:40.264698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f8809355-44bf-4b66-8231-92b86d1c9394 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:40.280669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8809355-44bf-4b66-8231-92b86d1c9394 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:40.281831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8809355-44bf-4b66-8231-92b86d1c9394 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:40.286728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8809355-44bf-4b66-8231-92b86d1c9394 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:40.289322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8809355-44bf-4b66-8231-92b86d1c9394 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:40.531305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:41.004303 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Flavor limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:06:41.004303 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Image limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:06:41.005070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Flavor pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:06:41.005178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Image pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:06:41.005896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:06:41.025155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:41.026047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:41.027058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:41.027655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:41.061564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Getting quotas for project 629a7b91ffc64154a55a45415f739949. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:06:41.061564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Getting quotas for user a8658730ea2a4a06b7b4070976c6397f and project 629a7b91ffc64154a55a45415f739949. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:06:41.065166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Going to run 1 instances... {{(pid=118256) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:06:41.068044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:06:41.266233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f8809355-44bf-4b66-8231-92b86d1c9394 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:41.275825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f8809355-44bf-4b66-8231-92b86d1c9394 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 1.019970 Jun 02 16:06:41.288147 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 19/36] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:40 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:41.292493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6b7f2618-5e70-4949-b0a2-ad647055c96a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.177553 Jun 02 16:06:41.293146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:06:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:06:41.303655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-057ee4c6-56ee-4550-b9ef-25ad4b2a9733 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:41.304385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-057ee4c6-56ee-4550-b9ef-25ad4b2a9733 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:41.791791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-057ee4c6-56ee-4550-b9ef-25ad4b2a9733 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:41.835789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-057ee4c6-56ee-4550-b9ef-25ad4b2a9733 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1222 microversion: 2.1 time: 0.535534 Jun 02 16:06:41.846268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 20/38] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:41 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1222 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:42.299477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8a6dbe57-eb15-45b0-8132-28ba5eb8e23d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:42.301748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-493896347", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:42.302412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8a6dbe57-eb15-45b0-8132-28ba5eb8e23d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:42.334735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8a6dbe57-eb15-45b0-8132-28ba5eb8e23d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:42.334735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8a6dbe57-eb15-45b0-8132-28ba5eb8e23d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:42.334735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8a6dbe57-eb15-45b0-8132-28ba5eb8e23d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:42.335248 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8a6dbe57-eb15-45b0-8132-28ba5eb8e23d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:42.487052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] validate_networks() for [('57598317-0238-4159-9273-26c98b610fc0', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:06:42.781305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8a6dbe57-eb15-45b0-8132-28ba5eb8e23d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:42.794737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8a6dbe57-eb15-45b0-8132-28ba5eb8e23d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.505660 Jun 02 16:06:42.807822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 19/39] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:42 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:43.815450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-736f4e9b-5480-4972-a3c8-c5356444aea2 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:43.817006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-736f4e9b-5480-4972-a3c8-c5356444aea2 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:43.828754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-736f4e9b-5480-4972-a3c8-c5356444aea2 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:43.832369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-736f4e9b-5480-4972-a3c8-c5356444aea2 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:43.832369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-736f4e9b-5480-4972-a3c8-c5356444aea2 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:43.834603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-736f4e9b-5480-4972-a3c8-c5356444aea2 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:44.593174 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-736f4e9b-5480-4972-a3c8-c5356444aea2 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:44.610581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-736f4e9b-5480-4972-a3c8-c5356444aea2 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.790977 Jun 02 16:06:44.612185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 20/40] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:43 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:06:45.412174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:06:45.413319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:06:45.414132 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:06:45.415282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:06:45.416366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:06:45.455737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:45.455737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:45.455737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:45.478768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:45.598690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Getting quotas for project 629a7b91ffc64154a55a45415f739949. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:06:45.615407 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Getting quotas for user a8658730ea2a4a06b7b4070976c6397f and project 629a7b91ffc64154a55a45415f739949. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:06:45.629996 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8c4985c5-dd92-4e88-9082-727b7383370c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:45.631401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8c4985c5-dd92-4e88-9082-727b7383370c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:45.648378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c4985c5-dd92-4e88-9082-727b7383370c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:45.648814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c4985c5-dd92-4e88-9082-727b7383370c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:45.649624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c4985c5-dd92-4e88-9082-727b7383370c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:45.668925 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c4985c5-dd92-4e88-9082-727b7383370c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:45.695706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:06:45.733170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:06:46.104609 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c348040a-dcf2-47ef-abff-6cd756760388 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.810501 Jun 02 16:06:46.122310 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 21/41] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:06:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 3829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:06:46.290671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-ae0bc678-a03e-4759-ab8c-59ae7a578aa2 req-20348816-8961-40d0-9a29-cad85d189991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dca03cf-a22a-4285-9da1-a8d857866775", "tag": "24662bd8-e12f-432f-962d-8ccdff736040"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:46.320688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-ae0bc678-a03e-4759-ab8c-59ae7a578aa2 req-20348816-8961-40d0-9a29-cad85d189991 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:46.328704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-ae0bc678-a03e-4759-ab8c-59ae7a578aa2 req-20348816-8961-40d0-9a29-cad85d189991 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:46.371737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-ae0bc678-a03e-4759-ab8c-59ae7a578aa2 req-20348816-8961-40d0-9a29-cad85d189991 service nova] Creating event network-changed:24662bd8-e12f-432f-962d-8ccdff736040 for instance 4dca03cf-a22a-4285-9da1-a8d857866775 on hv-cinder-79760 Jun 02 16:06:46.374993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-ae0bc678-a03e-4759-ab8c-59ae7a578aa2 req-20348816-8961-40d0-9a29-cad85d189991 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 16:06:46.384239 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c53a8008-6ed5-4df6-9895-1e396989fe86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:46.385112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c53a8008-6ed5-4df6-9895-1e396989fe86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:46.386293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c53a8008-6ed5-4df6-9895-1e396989fe86 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:46.393048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c53a8008-6ed5-4df6-9895-1e396989fe86 None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:46.406479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.compute.rpcapi [None req-c53a8008-6ed5-4df6-9895-1e396989fe86 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 16:06:46.408074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c53a8008-6ed5-4df6-9895-1e396989fe86 None None] Releasing lock "compute-rpcapi-router" {{(pid=118257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 16:06:46.455868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c53a8008-6ed5-4df6-9895-1e396989fe86 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327497 Jun 02 16:06:46.456811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 22/42] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:06:46.464740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9a94ccde-a989-4fa4-9d7a-75074e0e5463 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:46.486446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9a94ccde-a989-4fa4-9d7a-75074e0e5463 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:46.748205 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9a94ccde-a989-4fa4-9d7a-75074e0e5463 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:46.757750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9a94ccde-a989-4fa4-9d7a-75074e0e5463 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1221 microversion: 2.1 time: 0.299443 Jun 02 16:06:46.762753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 23/43] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:46 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1221 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:46.886007 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8c4985c5-dd92-4e88-9082-727b7383370c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:46.898662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8c4985c5-dd92-4e88-9082-727b7383370c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 1.271907 Jun 02 16:06:46.905578 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 21/44] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:45 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:47.780143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-67f23a17-fff1-4241-8a81-42092641959f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:47.780931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-67f23a17-fff1-4241-8a81-42092641959f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:47.788672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67f23a17-fff1-4241-8a81-42092641959f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:47.789122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67f23a17-fff1-4241-8a81-42092641959f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:47.790451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67f23a17-fff1-4241-8a81-42092641959f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:47.790888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67f23a17-fff1-4241-8a81-42092641959f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:47.883913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-67f23a17-fff1-4241-8a81-42092641959f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:47.895655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-67f23a17-fff1-4241-8a81-42092641959f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1225 microversion: 2.1 time: 0.120567 Jun 02 16:06:47.896534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 24/45] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:47 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:47.936382 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-62339d87-db76-4d9a-a17b-dcfef3aaa451 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:47.937519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-62339d87-db76-4d9a-a17b-dcfef3aaa451 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:47.953065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62339d87-db76-4d9a-a17b-dcfef3aaa451 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:47.953065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62339d87-db76-4d9a-a17b-dcfef3aaa451 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:47.953880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62339d87-db76-4d9a-a17b-dcfef3aaa451 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:47.954726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62339d87-db76-4d9a-a17b-dcfef3aaa451 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:48.243564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-244908097", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6e3f563-9a7e-4182-811c-dc16adc4c594"}], "security_groups": [{"name": "tempest-securitygroup--1915330229"}], "key_name": "tempest-keypair-909666240", "user_data": "}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:48.272955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-62339d87-db76-4d9a-a17b-dcfef3aaa451 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:48.284669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-62339d87-db76-4d9a-a17b-dcfef3aaa451 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.353903 Jun 02 16:06:48.290962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 22/46] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:47 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:48.876545 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] validate_networks() for [('d6e3f563-9a7e-4182-811c-dc16adc4c594', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:06:48.914035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-14c8d439-b67d-442e-bceb-102af8919fb7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:48.915461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-14c8d439-b67d-442e-bceb-102af8919fb7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:48.927675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14c8d439-b67d-442e-bceb-102af8919fb7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:48.929889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14c8d439-b67d-442e-bceb-102af8919fb7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:48.931246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14c8d439-b67d-442e-bceb-102af8919fb7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:48.931946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14c8d439-b67d-442e-bceb-102af8919fb7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:49.070598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-14c8d439-b67d-442e-bceb-102af8919fb7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:49.096149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-14c8d439-b67d-442e-bceb-102af8919fb7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1217 microversion: 2.1 time: 0.185208 Jun 02 16:06:49.097592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 23/47] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:48 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:06:49.308018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a6b12f20-4886-4e81-a678-31ee7889a6cf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:49.308573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a6b12f20-4886-4e81-a678-31ee7889a6cf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:49.322931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6b12f20-4886-4e81-a678-31ee7889a6cf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:49.326969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6b12f20-4886-4e81-a678-31ee7889a6cf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:49.331107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6b12f20-4886-4e81-a678-31ee7889a6cf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:49.331839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6b12f20-4886-4e81-a678-31ee7889a6cf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:50.146766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:06:50.150571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:06:50.153107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:06:50.153107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:06:50.153107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:06:50.234648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:50.236838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:50.252182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:50.253766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:50.299610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Getting quotas for project 9598d078f4a1477babe0eaf804ef54a8. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:06:50.316451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Getting quotas for user 88bb3d2dbcdb45bb8baba424e5239e21 and project 9598d078f4a1477babe0eaf804ef54a8. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:06:50.344155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:06:50.347009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:06:50.512956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a6b12f20-4886-4e81-a678-31ee7889a6cf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:50.513965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bfa36d15-dba1-405f-9b21-92b01c0baedb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.273913 Jun 02 16:06:50.522617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 25/48] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:06:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:06:50.529730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a6b12f20-4886-4e81-a678-31ee7889a6cf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 1.226540 Jun 02 16:06:50.530459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 24/49] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:49 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:06:50.535588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-08c21b3d-c55e-4e27-a671-9508faa0dda2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:50.536440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-08c21b3d-c55e-4e27-a671-9508faa0dda2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:50.537016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-50807b80-f10d-4b76-9a7a-bf7cb7296b94 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:50.537650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-50807b80-f10d-4b76-9a7a-bf7cb7296b94 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:50.555996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50807b80-f10d-4b76-9a7a-bf7cb7296b94 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:50.556669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50807b80-f10d-4b76-9a7a-bf7cb7296b94 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:50.557735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50807b80-f10d-4b76-9a7a-bf7cb7296b94 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:50.559074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50807b80-f10d-4b76-9a7a-bf7cb7296b94 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:50.613206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-08c21b3d-c55e-4e27-a671-9508faa0dda2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:50.622504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-08c21b3d-c55e-4e27-a671-9508faa0dda2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1236 microversion: 2.1 time: 0.090777 Jun 02 16:06:50.638051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 25/50] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:50 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:50.657672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-50807b80-f10d-4b76-9a7a-bf7cb7296b94 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:50.675187 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-50807b80-f10d-4b76-9a7a-bf7cb7296b94 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1281 microversion: 2.1 time: 0.157869 Jun 02 16:06:50.677906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 26/51] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:50 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:51.549460 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b3233cd1-0dbc-4fd8-8808-be5c3dd3320d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:51.551356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b3233cd1-0dbc-4fd8-8808-be5c3dd3320d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:51.562799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3233cd1-0dbc-4fd8-8808-be5c3dd3320d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:51.562799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3233cd1-0dbc-4fd8-8808-be5c3dd3320d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:51.563309 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3233cd1-0dbc-4fd8-8808-be5c3dd3320d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:51.563748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3233cd1-0dbc-4fd8-8808-be5c3dd3320d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:51.647182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-70e3267f-facd-4997-84f2-98c4b42e44b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:51.648758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-70e3267f-facd-4997-84f2-98c4b42e44b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:51.747944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-70e3267f-facd-4997-84f2-98c4b42e44b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:51.765986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-70e3267f-facd-4997-84f2-98c4b42e44b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1236 microversion: 2.1 time: 0.124642 Jun 02 16:06:51.766856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 27/52] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:51 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1236 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:51.771927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c891dcf0-8355-45fe-9215-0de16bd6c086 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:51.772966 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c891dcf0-8355-45fe-9215-0de16bd6c086 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:51.787233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c891dcf0-8355-45fe-9215-0de16bd6c086 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:51.787717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c891dcf0-8355-45fe-9215-0de16bd6c086 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:51.788892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c891dcf0-8355-45fe-9215-0de16bd6c086 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:51.789344 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c891dcf0-8355-45fe-9215-0de16bd6c086 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:51.789745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b3233cd1-0dbc-4fd8-8808-be5c3dd3320d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:51.801165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b3233cd1-0dbc-4fd8-8808-be5c3dd3320d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.257582 Jun 02 16:06:51.806515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 26/53] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:51 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:52.006828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c891dcf0-8355-45fe-9215-0de16bd6c086 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:52.006828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c891dcf0-8355-45fe-9215-0de16bd6c086 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1281 microversion: 2.1 time: 0.124246 Jun 02 16:06:52.006828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 28/54] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:51 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:52.786288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3ee8b2c5-08c1-413b-9eb1-4422a5a18dea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:52.787033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3ee8b2c5-08c1-413b-9eb1-4422a5a18dea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:52.789398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:52.797103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee8b2c5-08c1-413b-9eb1-4422a5a18dea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:52.797858 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee8b2c5-08c1-413b-9eb1-4422a5a18dea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:52.799121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee8b2c5-08c1-413b-9eb1-4422a5a18dea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:52.799821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee8b2c5-08c1-413b-9eb1-4422a5a18dea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:52.822388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-66176030-1796-411c-ac55-765d9a50ff9c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:52.823287 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-66176030-1796-411c-ac55-765d9a50ff9c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:52.830021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-66176030-1796-411c-ac55-765d9a50ff9c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:52.830698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-66176030-1796-411c-ac55-765d9a50ff9c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:52.839471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-66176030-1796-411c-ac55-765d9a50ff9c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:52.839471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-66176030-1796-411c-ac55-765d9a50ff9c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:52.887395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3ee8b2c5-08c1-413b-9eb1-4422a5a18dea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:52.895418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3ee8b2c5-08c1-413b-9eb1-4422a5a18dea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1240 microversion: 2.1 time: 0.113589 Jun 02 16:06:52.896109 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 27/55] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:52 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:52.976909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-66176030-1796-411c-ac55-765d9a50ff9c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:52.985711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-66176030-1796-411c-ac55-765d9a50ff9c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.168713 Jun 02 16:06:52.987466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 29/56] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:52 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:53.002709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e64ffdee-9015-46a2-b26f-3fbe7c419882 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:53.003331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e64ffdee-9015-46a2-b26f-3fbe7c419882 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:53.009818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e64ffdee-9015-46a2-b26f-3fbe7c419882 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:53.010387 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e64ffdee-9015-46a2-b26f-3fbe7c419882 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:53.011169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e64ffdee-9015-46a2-b26f-3fbe7c419882 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:53.011616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e64ffdee-9015-46a2-b26f-3fbe7c419882 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:53.081897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e64ffdee-9015-46a2-b26f-3fbe7c419882 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:53.090187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e64ffdee-9015-46a2-b26f-3fbe7c419882 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1281 microversion: 2.1 time: 0.091155 Jun 02 16:06:53.090766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 28/57] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:52 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:53.912627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7add6c9f-3ac2-436e-9212-de76110853f7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:53.913382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7add6c9f-3ac2-436e-9212-de76110853f7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:53.919872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7add6c9f-3ac2-436e-9212-de76110853f7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:53.920403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7add6c9f-3ac2-436e-9212-de76110853f7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:53.921252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7add6c9f-3ac2-436e-9212-de76110853f7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:53.921766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7add6c9f-3ac2-436e-9212-de76110853f7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:53.986066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7add6c9f-3ac2-436e-9212-de76110853f7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:53.996781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7add6c9f-3ac2-436e-9212-de76110853f7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1240 microversion: 2.1 time: 0.088147 Jun 02 16:06:54.007082 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 30/58] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:53 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:54.007837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ae055d00-1db9-4afe-936b-fa5887a7f2d8 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:54.009173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ae055d00-1db9-4afe-936b-fa5887a7f2d8 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:54.015428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ae055d00-1db9-4afe-936b-fa5887a7f2d8 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:54.016263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ae055d00-1db9-4afe-936b-fa5887a7f2d8 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:54.017111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ae055d00-1db9-4afe-936b-fa5887a7f2d8 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:54.017612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ae055d00-1db9-4afe-936b-fa5887a7f2d8 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:54.108864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-381a8d2e-93c6-40c0-af25-ec518f95a694 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:54.109488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-381a8d2e-93c6-40c0-af25-ec518f95a694 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:54.118306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381a8d2e-93c6-40c0-af25-ec518f95a694 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:54.119112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381a8d2e-93c6-40c0-af25-ec518f95a694 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:54.119956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381a8d2e-93c6-40c0-af25-ec518f95a694 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:54.120402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381a8d2e-93c6-40c0-af25-ec518f95a694 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:54.165687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ae055d00-1db9-4afe-936b-fa5887a7f2d8 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:54.173699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ae055d00-1db9-4afe-936b-fa5887a7f2d8 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.170459 Jun 02 16:06:54.174318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 29/59] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:54 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:54.191358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-381a8d2e-93c6-40c0-af25-ec518f95a694 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:54.199216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-381a8d2e-93c6-40c0-af25-ec518f95a694 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1281 microversion: 2.1 time: 0.094187 Jun 02 16:06:54.205241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 31/60] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:54 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:06:55.013942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bc558d28-b3b9-407b-8dd3-e70dcae53fe0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:55.014599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bc558d28-b3b9-407b-8dd3-e70dcae53fe0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:55.020779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc558d28-b3b9-407b-8dd3-e70dcae53fe0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:55.021223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc558d28-b3b9-407b-8dd3-e70dcae53fe0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:55.021976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc558d28-b3b9-407b-8dd3-e70dcae53fe0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:55.022435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc558d28-b3b9-407b-8dd3-e70dcae53fe0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:55.087363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bc558d28-b3b9-407b-8dd3-e70dcae53fe0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:55.094924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bc558d28-b3b9-407b-8dd3-e70dcae53fe0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1240 microversion: 2.1 time: 0.084923 Jun 02 16:06:55.096347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 30/61] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:55 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:55.207510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d150e4d2-9e3e-44f8-a882-919b5a56182b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:55.208154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d150e4d2-9e3e-44f8-a882-919b5a56182b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:55.215822 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d150e4d2-9e3e-44f8-a882-919b5a56182b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:55.216530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d150e4d2-9e3e-44f8-a882-919b5a56182b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:55.217536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d150e4d2-9e3e-44f8-a882-919b5a56182b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:55.218271 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d150e4d2-9e3e-44f8-a882-919b5a56182b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:55.220797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-02605121-3015-4583-89c0-85050c760b75 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:55.221429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-02605121-3015-4583-89c0-85050c760b75 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:55.229599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-02605121-3015-4583-89c0-85050c760b75 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:55.230040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-02605121-3015-4583-89c0-85050c760b75 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:55.232032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-02605121-3015-4583-89c0-85050c760b75 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:55.232649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-02605121-3015-4583-89c0-85050c760b75 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:55.304012 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-02605121-3015-4583-89c0-85050c760b75 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:55.311801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-02605121-3015-4583-89c0-85050c760b75 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1281 microversion: 2.1 time: 0.094864 Jun 02 16:06:55.321673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 31/62] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:55 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:55.364049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d150e4d2-9e3e-44f8-a882-919b5a56182b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:55.372017 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d150e4d2-9e3e-44f8-a882-919b5a56182b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.184718 Jun 02 16:06:55.372589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 32/63] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:55 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:56.112239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-14bd6137-6d8b-48b0-86d6-1c3ee4f1d112 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:56.112852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-14bd6137-6d8b-48b0-86d6-1c3ee4f1d112 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:56.119941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14bd6137-6d8b-48b0-86d6-1c3ee4f1d112 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:56.120393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14bd6137-6d8b-48b0-86d6-1c3ee4f1d112 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:56.121160 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14bd6137-6d8b-48b0-86d6-1c3ee4f1d112 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:56.121595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14bd6137-6d8b-48b0-86d6-1c3ee4f1d112 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:56.188059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-14bd6137-6d8b-48b0-86d6-1c3ee4f1d112 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:56.195813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-14bd6137-6d8b-48b0-86d6-1c3ee4f1d112 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1240 microversion: 2.1 time: 0.087383 Jun 02 16:06:56.196444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 32/64] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:56 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:56.328974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-98ea3719-9d93-44b4-af3d-c26e5da188ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:56.329829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-98ea3719-9d93-44b4-af3d-c26e5da188ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:56.334497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:56.339390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98ea3719-9d93-44b4-af3d-c26e5da188ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:56.339865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98ea3719-9d93-44b4-af3d-c26e5da188ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:56.340751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98ea3719-9d93-44b4-af3d-c26e5da188ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:56.341114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98ea3719-9d93-44b4-af3d-c26e5da188ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:56.345571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=69 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:56.388773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c4d1d671-70a3-454e-9163-5ad591bfaa41 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:56.389382 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c4d1d671-70a3-454e-9163-5ad591bfaa41 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:56.391359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:56.397493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4d1d671-70a3-454e-9163-5ad591bfaa41 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:56.397493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4d1d671-70a3-454e-9163-5ad591bfaa41 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:56.403306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4d1d671-70a3-454e-9163-5ad591bfaa41 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:56.403871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4d1d671-70a3-454e-9163-5ad591bfaa41 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:56.417753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-98ea3719-9d93-44b4-af3d-c26e5da188ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:56.426549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-98ea3719-9d93-44b4-af3d-c26e5da188ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1281 microversion: 2.1 time: 0.101249 Jun 02 16:06:56.429138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=89 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:56.436938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 33/65] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:56 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:56.553656 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c4d1d671-70a3-454e-9163-5ad591bfaa41 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:56.561435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c4d1d671-70a3-454e-9163-5ad591bfaa41 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.176437 Jun 02 16:06:56.564887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 33/66] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:56 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:57.213119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d95c716f-0903-4650-b88b-4ef8724b5f9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:57.213729 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d95c716f-0903-4650-b88b-4ef8724b5f9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:57.221126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d95c716f-0903-4650-b88b-4ef8724b5f9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:57.221572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d95c716f-0903-4650-b88b-4ef8724b5f9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:57.222356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d95c716f-0903-4650-b88b-4ef8724b5f9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:57.222792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d95c716f-0903-4650-b88b-4ef8724b5f9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:57.287450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d95c716f-0903-4650-b88b-4ef8724b5f9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:57.296211 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d95c716f-0903-4650-b88b-4ef8724b5f9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1240 microversion: 2.1 time: 0.087049 Jun 02 16:06:57.296798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 34/67] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:57 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:06:57.444487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-704ff256-a937-41a6-aac4-4766ce107f50 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:57.445101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-704ff256-a937-41a6-aac4-4766ce107f50 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:57.460061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-704ff256-a937-41a6-aac4-4766ce107f50 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:57.460061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-704ff256-a937-41a6-aac4-4766ce107f50 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:57.460061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-704ff256-a937-41a6-aac4-4766ce107f50 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:57.460061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-704ff256-a937-41a6-aac4-4766ce107f50 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:57.554196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-704ff256-a937-41a6-aac4-4766ce107f50 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:57.563114 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-704ff256-a937-41a6-aac4-4766ce107f50 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1281 microversion: 2.1 time: 0.123168 Jun 02 16:06:57.564425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 34/68] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:57 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:57.578139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cb6a075c-df0b-488d-89c4-ee9cbab965a3 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:57.579368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cb6a075c-df0b-488d-89c4-ee9cbab965a3 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:57.586030 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb6a075c-df0b-488d-89c4-ee9cbab965a3 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:57.586679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb6a075c-df0b-488d-89c4-ee9cbab965a3 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:57.587858 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb6a075c-df0b-488d-89c4-ee9cbab965a3 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:57.588019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb6a075c-df0b-488d-89c4-ee9cbab965a3 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:57.905973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cb6a075c-df0b-488d-89c4-ee9cbab965a3 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:57.929866 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cb6a075c-df0b-488d-89c4-ee9cbab965a3 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.355474 Jun 02 16:06:57.930827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 35/69] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:57 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:58.315628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-af549621-99d8-4f76-b74c-c7fa7de79497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:58.316429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-af549621-99d8-4f76-b74c-c7fa7de79497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:58.323305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af549621-99d8-4f76-b74c-c7fa7de79497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:58.323752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af549621-99d8-4f76-b74c-c7fa7de79497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:58.324525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af549621-99d8-4f76-b74c-c7fa7de79497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:58.324954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af549621-99d8-4f76-b74c-c7fa7de79497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:58.392732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-af549621-99d8-4f76-b74c-c7fa7de79497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:58.404405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-af549621-99d8-4f76-b74c-c7fa7de79497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1232 microversion: 2.1 time: 0.093148 Jun 02 16:06:58.405921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 35/70] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:58 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1232 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:58.580908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a9805735-9485-4579-9762-1b338b9e6897 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:58.581534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a9805735-9485-4579-9762-1b338b9e6897 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:58.589207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9805735-9485-4579-9762-1b338b9e6897 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:58.589849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9805735-9485-4579-9762-1b338b9e6897 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:58.590651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9805735-9485-4579-9762-1b338b9e6897 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:58.591088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9805735-9485-4579-9762-1b338b9e6897 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:58.692178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a9805735-9485-4579-9762-1b338b9e6897 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:58.708135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a9805735-9485-4579-9762-1b338b9e6897 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1279 microversion: 2.1 time: 0.130054 Jun 02 16:06:58.709525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 36/71] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:58 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1279 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:58.946801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a5a7e6f4-15b5-447e-a8a7-cb728c2a9513 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:58.948158 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a5a7e6f4-15b5-447e-a8a7-cb728c2a9513 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:58.964118 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5a7e6f4-15b5-447e-a8a7-cb728c2a9513 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:58.964576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5a7e6f4-15b5-447e-a8a7-cb728c2a9513 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:58.967236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5a7e6f4-15b5-447e-a8a7-cb728c2a9513 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:58.967685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5a7e6f4-15b5-447e-a8a7-cb728c2a9513 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:59.171332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a5a7e6f4-15b5-447e-a8a7-cb728c2a9513 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:59.178806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a5a7e6f4-15b5-447e-a8a7-cb728c2a9513 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.235811 Jun 02 16:06:59.182412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 36/72] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:58 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:59.421853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-55de27bc-7fd5-4f61-b02d-c8ed6c83b020 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:59.422499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-55de27bc-7fd5-4f61-b02d-c8ed6c83b020 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:59.430566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-25cd612d-e115-423a-9e46-aa9960dd0cf2 req-3c9a27a8-5e19-44d2-a13b-9d7d8b52bd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc302fd8-397a-45ed-9316-d78c9f5b324a", "tag": "fbd1d709-759c-4885-a8dc-e6d908c97d61"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:06:59.432337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55de27bc-7fd5-4f61-b02d-c8ed6c83b020 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:59.432698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55de27bc-7fd5-4f61-b02d-c8ed6c83b020 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:59.453064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-25cd612d-e115-423a-9e46-aa9960dd0cf2 req-3c9a27a8-5e19-44d2-a13b-9d7d8b52bd14 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:59.453506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-25cd612d-e115-423a-9e46-aa9960dd0cf2 req-3c9a27a8-5e19-44d2-a13b-9d7d8b52bd14 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:59.457982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55de27bc-7fd5-4f61-b02d-c8ed6c83b020 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:59.462944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55de27bc-7fd5-4f61-b02d-c8ed6c83b020 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:59.482838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-25cd612d-e115-423a-9e46-aa9960dd0cf2 req-3c9a27a8-5e19-44d2-a13b-9d7d8b52bd14 service nova] Creating event network-changed:fbd1d709-759c-4885-a8dc-e6d908c97d61 for instance fc302fd8-397a-45ed-9316-d78c9f5b324a on hv-cinder-79760 Jun 02 16:06:59.483370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-25cd612d-e115-423a-9e46-aa9960dd0cf2 req-3c9a27a8-5e19-44d2-a13b-9d7d8b52bd14 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 16:06:59.484522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c03e10b-402f-44dc-a759-48cd5e9b5a2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:59.484950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c03e10b-402f-44dc-a759-48cd5e9b5a2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:59.485718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c03e10b-402f-44dc-a759-48cd5e9b5a2d None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:59.486165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c03e10b-402f-44dc-a759-48cd5e9b5a2d None None] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:59.511474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.compute.rpcapi [None req-2c03e10b-402f-44dc-a759-48cd5e9b5a2d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 16:06:59.512389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c03e10b-402f-44dc-a759-48cd5e9b5a2d None None] Releasing lock "compute-rpcapi-router" {{(pid=118256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 16:06:59.551818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2c03e10b-402f-44dc-a759-48cd5e9b5a2d None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125361 Jun 02 16:06:59.552426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 37/73] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:06:59.605714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-55de27bc-7fd5-4f61-b02d-c8ed6c83b020 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:59.617667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-55de27bc-7fd5-4f61-b02d-c8ed6c83b020 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1288 microversion: 2.1 time: 0.199744 Jun 02 16:06:59.622681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 37/74] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:59 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1288 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:06:59.734064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e892540e-dd01-41d1-8f57-d8057072421a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:06:59.734064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e892540e-dd01-41d1-8f57-d8057072421a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:06:59.740846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e892540e-dd01-41d1-8f57-d8057072421a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:59.741535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e892540e-dd01-41d1-8f57-d8057072421a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:59.742416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e892540e-dd01-41d1-8f57-d8057072421a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:06:59.743050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e892540e-dd01-41d1-8f57-d8057072421a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:06:59.974189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e892540e-dd01-41d1-8f57-d8057072421a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:06:59.985076 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e892540e-dd01-41d1-8f57-d8057072421a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.258014 Jun 02 16:06:59.985847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 38/75] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:06:59 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:00.204411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b39002c2-dc25-42ce-89ed-62d553cdc9c1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:00.206836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b39002c2-dc25-42ce-89ed-62d553cdc9c1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:00.214428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b39002c2-dc25-42ce-89ed-62d553cdc9c1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:00.214883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b39002c2-dc25-42ce-89ed-62d553cdc9c1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:00.215661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b39002c2-dc25-42ce-89ed-62d553cdc9c1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:00.216099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b39002c2-dc25-42ce-89ed-62d553cdc9c1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:00.265994 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=6 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:00.376383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b39002c2-dc25-42ce-89ed-62d553cdc9c1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:00.384565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b39002c2-dc25-42ce-89ed-62d553cdc9c1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.190766 Jun 02 16:07:00.385129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 38/76] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:00 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:00.642576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f03ef890-3cf2-4a37-810a-86868cde0a57 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:00.642576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f03ef890-3cf2-4a37-810a-86868cde0a57 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:00.642576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=20 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:00.645640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f03ef890-3cf2-4a37-810a-86868cde0a57 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:00.646099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f03ef890-3cf2-4a37-810a-86868cde0a57 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:00.646868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f03ef890-3cf2-4a37-810a-86868cde0a57 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:00.647295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f03ef890-3cf2-4a37-810a-86868cde0a57 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:00.720431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f03ef890-3cf2-4a37-810a-86868cde0a57 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:00.728726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f03ef890-3cf2-4a37-810a-86868cde0a57 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1288 microversion: 2.1 time: 0.097094 Jun 02 16:07:00.729304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 39/77] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:00 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:01.002786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bc07625d-79d6-42d6-b570-6f24c346a8ef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:01.003487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bc07625d-79d6-42d6-b570-6f24c346a8ef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:01.010516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bc07625d-79d6-42d6-b570-6f24c346a8ef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:01.010969 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bc07625d-79d6-42d6-b570-6f24c346a8ef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:01.011725 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bc07625d-79d6-42d6-b570-6f24c346a8ef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:01.012154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bc07625d-79d6-42d6-b570-6f24c346a8ef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:01.191256 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bc07625d-79d6-42d6-b570-6f24c346a8ef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:01.198937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bc07625d-79d6-42d6-b570-6f24c346a8ef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.199841 Jun 02 16:07:01.199525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 39/78] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:00 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:01.401774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-aee7e814-9221-4a4d-bdcf-1c6abc11b205 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:01.402478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-aee7e814-9221-4a4d-bdcf-1c6abc11b205 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:01.413336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aee7e814-9221-4a4d-bdcf-1c6abc11b205 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:01.413788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aee7e814-9221-4a4d-bdcf-1c6abc11b205 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:01.416854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aee7e814-9221-4a4d-bdcf-1c6abc11b205 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:01.416854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aee7e814-9221-4a4d-bdcf-1c6abc11b205 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:01.620928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-aee7e814-9221-4a4d-bdcf-1c6abc11b205 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:01.647554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-aee7e814-9221-4a4d-bdcf-1c6abc11b205 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.250037 Jun 02 16:07:01.648075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 40/79] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:01 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:01.751658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f1b434b4-3f1a-424a-90c4-8d627bd6a275 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:01.752502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f1b434b4-3f1a-424a-90c4-8d627bd6a275 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:01.760976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1b434b4-3f1a-424a-90c4-8d627bd6a275 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:01.761430 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1b434b4-3f1a-424a-90c4-8d627bd6a275 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:01.764315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1b434b4-3f1a-424a-90c4-8d627bd6a275 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:01.765464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1b434b4-3f1a-424a-90c4-8d627bd6a275 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:01.766530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=22 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:01.865821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f1b434b4-3f1a-424a-90c4-8d627bd6a275 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:01.876000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f1b434b4-3f1a-424a-90c4-8d627bd6a275 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1288 microversion: 2.1 time: 0.129486 Jun 02 16:07:01.876779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 40/80] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:01 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1288 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:02.216260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-04020346-e42b-41c6-acd8-214474036cd9 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:02.216866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-04020346-e42b-41c6-acd8-214474036cd9 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:02.234934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04020346-e42b-41c6-acd8-214474036cd9 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:02.236351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04020346-e42b-41c6-acd8-214474036cd9 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:02.237344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04020346-e42b-41c6-acd8-214474036cd9 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:02.237941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04020346-e42b-41c6-acd8-214474036cd9 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:02.435567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-04020346-e42b-41c6-acd8-214474036cd9 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:02.443082 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-04020346-e42b-41c6-acd8-214474036cd9 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.231639 Jun 02 16:07:02.444331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 41/81] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:02 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:02.668059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-70238e69-21bd-431e-aafe-2bc6f4363ea4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:02.672906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-70238e69-21bd-431e-aafe-2bc6f4363ea4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:02.687271 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-70238e69-21bd-431e-aafe-2bc6f4363ea4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:02.687618 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-70238e69-21bd-431e-aafe-2bc6f4363ea4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:02.690147 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-70238e69-21bd-431e-aafe-2bc6f4363ea4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:02.690645 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-70238e69-21bd-431e-aafe-2bc6f4363ea4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:02.900940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fb016b45-f394-4f0c-883d-d9d5a45da24e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:02.901594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fb016b45-f394-4f0c-883d-d9d5a45da24e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:02.908255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb016b45-f394-4f0c-883d-d9d5a45da24e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:02.908704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb016b45-f394-4f0c-883d-d9d5a45da24e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:02.909502 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb016b45-f394-4f0c-883d-d9d5a45da24e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:02.909933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb016b45-f394-4f0c-883d-d9d5a45da24e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:02.976497 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fb016b45-f394-4f0c-883d-d9d5a45da24e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:02.985035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fb016b45-f394-4f0c-883d-d9d5a45da24e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1294 microversion: 2.1 time: 0.092103 Jun 02 16:07:02.985612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 42/82] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:02 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:03.011597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-70238e69-21bd-431e-aafe-2bc6f4363ea4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:03.019242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-70238e69-21bd-431e-aafe-2bc6f4363ea4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.358253 Jun 02 16:07:03.020177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 41/83] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:02 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:03.204030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-fdaffa1f-5aac-4acb-9eec-d0d1efd5d15f req-da8c7acd-aa7f-4551-b2f8-b187317cee5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d2a6ab-d9d6-4043-90ae-76da9f639df4", "tag": "f0173a42-e08a-48e6-a40a-dd060bef661a"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:03.218753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-fdaffa1f-5aac-4acb-9eec-d0d1efd5d15f req-da8c7acd-aa7f-4551-b2f8-b187317cee5c service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:03.220969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-fdaffa1f-5aac-4acb-9eec-d0d1efd5d15f req-da8c7acd-aa7f-4551-b2f8-b187317cee5c service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:03.240962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-fdaffa1f-5aac-4acb-9eec-d0d1efd5d15f req-da8c7acd-aa7f-4551-b2f8-b187317cee5c service nova] Creating event network-changed:f0173a42-e08a-48e6-a40a-dd060bef661a for instance 38d2a6ab-d9d6-4043-90ae-76da9f639df4 on hv-cinder-79760 Jun 02 16:07:03.249714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-fdaffa1f-5aac-4acb-9eec-d0d1efd5d15f req-da8c7acd-aa7f-4551-b2f8-b187317cee5c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055956 Jun 02 16:07:03.251169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 43/84] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:07:03.460858 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4a5d893e-53ec-4024-b41f-1513a7366b3b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:03.470621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4a5d893e-53ec-4024-b41f-1513a7366b3b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:03.470621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a5d893e-53ec-4024-b41f-1513a7366b3b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:03.471096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a5d893e-53ec-4024-b41f-1513a7366b3b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:03.471907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a5d893e-53ec-4024-b41f-1513a7366b3b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:03.472347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a5d893e-53ec-4024-b41f-1513a7366b3b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:03.656357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4a5d893e-53ec-4024-b41f-1513a7366b3b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:03.668844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4a5d893e-53ec-4024-b41f-1513a7366b3b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.211759 Jun 02 16:07:03.671204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 42/85] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:03 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:04.003956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2f1aeff0-5098-4509-9482-eefb77dc5aa9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:04.004649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2f1aeff0-5098-4509-9482-eefb77dc5aa9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:04.011174 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2f1aeff0-5098-4509-9482-eefb77dc5aa9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:04.011623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2f1aeff0-5098-4509-9482-eefb77dc5aa9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:04.012384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2f1aeff0-5098-4509-9482-eefb77dc5aa9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:04.012819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2f1aeff0-5098-4509-9482-eefb77dc5aa9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:04.036958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9cd6a5cc-909f-4a40-a9ee-1826ec40776c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:04.037977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9cd6a5cc-909f-4a40-a9ee-1826ec40776c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:04.045333 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cd6a5cc-909f-4a40-a9ee-1826ec40776c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:04.045970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cd6a5cc-909f-4a40-a9ee-1826ec40776c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:04.046914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cd6a5cc-909f-4a40-a9ee-1826ec40776c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:04.047350 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cd6a5cc-909f-4a40-a9ee-1826ec40776c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:04.219815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9cd6a5cc-909f-4a40-a9ee-1826ec40776c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:04.224053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2f1aeff0-5098-4509-9482-eefb77dc5aa9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:04.227463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9cd6a5cc-909f-4a40-a9ee-1826ec40776c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.194411 Jun 02 16:07:04.228750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 43/86] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:04 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:04.236302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2f1aeff0-5098-4509-9482-eefb77dc5aa9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.236551 Jun 02 16:07:04.246136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 44/87] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:03 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:04.687128 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1c9708c0-936d-4845-9709-ccb5d2acc53f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:04.688439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1c9708c0-936d-4845-9709-ccb5d2acc53f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:04.694639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1c9708c0-936d-4845-9709-ccb5d2acc53f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:04.695204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1c9708c0-936d-4845-9709-ccb5d2acc53f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:04.697075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1c9708c0-936d-4845-9709-ccb5d2acc53f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:04.697529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1c9708c0-936d-4845-9709-ccb5d2acc53f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:04.843505 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1c9708c0-936d-4845-9709-ccb5d2acc53f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:04.851764 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1c9708c0-936d-4845-9709-ccb5d2acc53f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.168532 Jun 02 16:07:04.852443 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 44/88] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:04 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:05.244325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-103017cc-92da-441c-bdbe-48ee1c685e53 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:05.253353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-103017cc-92da-441c-bdbe-48ee1c685e53 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:05.253353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-103017cc-92da-441c-bdbe-48ee1c685e53 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:05.253353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-103017cc-92da-441c-bdbe-48ee1c685e53 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:05.253647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-120cfba1-f856-4a3f-8681-3ae10d058be5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:05.253742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-103017cc-92da-441c-bdbe-48ee1c685e53 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:05.253836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-120cfba1-f856-4a3f-8681-3ae10d058be5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:05.254275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-103017cc-92da-441c-bdbe-48ee1c685e53 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:05.260974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-120cfba1-f856-4a3f-8681-3ae10d058be5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:05.261434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-120cfba1-f856-4a3f-8681-3ae10d058be5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:05.262232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-120cfba1-f856-4a3f-8681-3ae10d058be5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:05.262668 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-120cfba1-f856-4a3f-8681-3ae10d058be5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:05.431854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-103017cc-92da-441c-bdbe-48ee1c685e53 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:05.438004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-120cfba1-f856-4a3f-8681-3ae10d058be5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:05.440315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-103017cc-92da-441c-bdbe-48ee1c685e53 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.199903 Jun 02 16:07:05.441104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 45/89] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:05 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:05.447900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-120cfba1-f856-4a3f-8681-3ae10d058be5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.198936 Jun 02 16:07:05.448742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 45/90] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:05 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:05.871111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d9438d2e-9ce4-457b-8d2d-d15c51ac96a8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:05.871874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d9438d2e-9ce4-457b-8d2d-d15c51ac96a8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:05.885660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9438d2e-9ce4-457b-8d2d-d15c51ac96a8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:05.886948 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9438d2e-9ce4-457b-8d2d-d15c51ac96a8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:05.888924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9438d2e-9ce4-457b-8d2d-d15c51ac96a8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:05.888924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9438d2e-9ce4-457b-8d2d-d15c51ac96a8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:06.076053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d9438d2e-9ce4-457b-8d2d-d15c51ac96a8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:06.079934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d9438d2e-9ce4-457b-8d2d-d15c51ac96a8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.214917 Jun 02 16:07:06.083052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 46/91] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:05 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:06.167442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-152ba6d1-07ff-4caf-8764-051c885412a2 req-04716b41-ce5e-4df7-9864-acb376c3cb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dca03cf-a22a-4285-9da1-a8d857866775", "name": "network-vif-plugged", "status": "completed", "tag": "24662bd8-e12f-432f-962d-8ccdff736040"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:06.188541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-152ba6d1-07ff-4caf-8764-051c885412a2 req-04716b41-ce5e-4df7-9864-acb376c3cb7f service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:06.188989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-152ba6d1-07ff-4caf-8764-051c885412a2 req-04716b41-ce5e-4df7-9864-acb376c3cb7f service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:06.224128 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-152ba6d1-07ff-4caf-8764-051c885412a2 req-04716b41-ce5e-4df7-9864-acb376c3cb7f service nova] Creating event network-vif-plugged:24662bd8-e12f-432f-962d-8ccdff736040 for instance 4dca03cf-a22a-4285-9da1-a8d857866775 on hv-cinder-79760 Jun 02 16:07:06.244092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-152ba6d1-07ff-4caf-8764-051c885412a2 req-04716b41-ce5e-4df7-9864-acb376c3cb7f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297653 Jun 02 16:07:06.249614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 46/92] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:07:06.465412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-96a66d5e-da7d-49ce-8c80-98774fc3ddbf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:06.466306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-96a66d5e-da7d-49ce-8c80-98774fc3ddbf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:06.466768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a262f8c0-9fc3-4cc6-abfb-bf09951b7dc5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:06.467657 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a262f8c0-9fc3-4cc6-abfb-bf09951b7dc5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:06.480439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96a66d5e-da7d-49ce-8c80-98774fc3ddbf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:06.480990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96a66d5e-da7d-49ce-8c80-98774fc3ddbf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:06.481206 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a262f8c0-9fc3-4cc6-abfb-bf09951b7dc5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:06.481781 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96a66d5e-da7d-49ce-8c80-98774fc3ddbf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:06.486183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a262f8c0-9fc3-4cc6-abfb-bf09951b7dc5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:06.486302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96a66d5e-da7d-49ce-8c80-98774fc3ddbf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:06.486392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a262f8c0-9fc3-4cc6-abfb-bf09951b7dc5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:06.486392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a262f8c0-9fc3-4cc6-abfb-bf09951b7dc5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:06.946929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-96a66d5e-da7d-49ce-8c80-98774fc3ddbf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:06.953894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-96a66d5e-da7d-49ce-8c80-98774fc3ddbf tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.497852 Jun 02 16:07:06.955135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 47/93] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:06 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:07.099470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c497db82-dc06-4e6e-97aa-42fab4c87111 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:07.099470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c497db82-dc06-4e6e-97aa-42fab4c87111 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:07.106899 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c497db82-dc06-4e6e-97aa-42fab4c87111 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:07.109829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c497db82-dc06-4e6e-97aa-42fab4c87111 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:07.111077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c497db82-dc06-4e6e-97aa-42fab4c87111 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:07.114176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c497db82-dc06-4e6e-97aa-42fab4c87111 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:07.197671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a262f8c0-9fc3-4cc6-abfb-bf09951b7dc5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:07.216297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a262f8c0-9fc3-4cc6-abfb-bf09951b7dc5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.755091 Jun 02 16:07:07.217117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 47/94] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:06 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:07.388346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c497db82-dc06-4e6e-97aa-42fab4c87111 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:07.396937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c497db82-dc06-4e6e-97aa-42fab4c87111 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.303985 Jun 02 16:07:07.399474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 48/95] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:07 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:07.447194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-7cc5cc1d-751f-4e36-93fd-9e0dac89a3d2 req-4ab19fcf-e44c-4f90-a551-b9ac6a09438b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90430f1e-1a79-4ab9-b7f7-c44ee8c064d5", "tag": "ef63a7f5-6a5e-4b24-a830-c7caf3ad05ec"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:07.463983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-7cc5cc1d-751f-4e36-93fd-9e0dac89a3d2 req-4ab19fcf-e44c-4f90-a551-b9ac6a09438b service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:07.464534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-7cc5cc1d-751f-4e36-93fd-9e0dac89a3d2 req-4ab19fcf-e44c-4f90-a551-b9ac6a09438b service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:07.489361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-7cc5cc1d-751f-4e36-93fd-9e0dac89a3d2 req-4ab19fcf-e44c-4f90-a551-b9ac6a09438b service nova] Creating event network-changed:ef63a7f5-6a5e-4b24-a830-c7caf3ad05ec for instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 on hv-cinder-79760 Jun 02 16:07:07.495323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-7cc5cc1d-751f-4e36-93fd-9e0dac89a3d2 req-4ab19fcf-e44c-4f90-a551-b9ac6a09438b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052298 Jun 02 16:07:07.496307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 48/96] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:07:07.970936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e455e6dc-194d-43ef-8e86-3e1584571d50 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:07.971536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e455e6dc-194d-43ef-8e86-3e1584571d50 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:07.977959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e455e6dc-194d-43ef-8e86-3e1584571d50 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:07.978434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e455e6dc-194d-43ef-8e86-3e1584571d50 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:07.979195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e455e6dc-194d-43ef-8e86-3e1584571d50 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:07.979621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e455e6dc-194d-43ef-8e86-3e1584571d50 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:08.132219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e455e6dc-194d-43ef-8e86-3e1584571d50 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:08.141319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e455e6dc-194d-43ef-8e86-3e1584571d50 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.174223 Jun 02 16:07:08.152764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 49/97] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:07 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:08.242548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-256dc84b-e1b5-49d9-ae99-76ef2519c9b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:08.244078 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-256dc84b-e1b5-49d9-ae99-76ef2519c9b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:08.251075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-256dc84b-e1b5-49d9-ae99-76ef2519c9b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:08.252549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-256dc84b-e1b5-49d9-ae99-76ef2519c9b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:08.253475 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-256dc84b-e1b5-49d9-ae99-76ef2519c9b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:08.254177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-256dc84b-e1b5-49d9-ae99-76ef2519c9b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:08.407948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-256dc84b-e1b5-49d9-ae99-76ef2519c9b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:08.415496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c9eb3ef7-6691-4078-bba8-24831552cab3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:08.416108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c9eb3ef7-6691-4078-bba8-24831552cab3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:08.419535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-256dc84b-e1b5-49d9-ae99-76ef2519c9b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.182129 Jun 02 16:07:08.420545 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 49/98] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:08 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:08.434226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9eb3ef7-6691-4078-bba8-24831552cab3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:08.434671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9eb3ef7-6691-4078-bba8-24831552cab3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:08.435443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9eb3ef7-6691-4078-bba8-24831552cab3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:08.435871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9eb3ef7-6691-4078-bba8-24831552cab3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:08.735842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c9eb3ef7-6691-4078-bba8-24831552cab3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:08.738199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:08.745609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c9eb3ef7-6691-4078-bba8-24831552cab3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.334489 Jun 02 16:07:08.754922 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 50/99] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:08 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:09.158678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-905adb69-6cbe-446f-9c81-288d8194737b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:09.159293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-905adb69-6cbe-446f-9c81-288d8194737b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:09.165976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-905adb69-6cbe-446f-9c81-288d8194737b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:09.166880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-905adb69-6cbe-446f-9c81-288d8194737b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:09.167659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-905adb69-6cbe-446f-9c81-288d8194737b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:09.168096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-905adb69-6cbe-446f-9c81-288d8194737b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:09.313154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-905adb69-6cbe-446f-9c81-288d8194737b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:09.325306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-905adb69-6cbe-446f-9c81-288d8194737b tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.170453 Jun 02 16:07:09.325883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 50/100] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:09 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:09.356847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-557d8019-6838-4074-9f4a-4e1d0ba162fc req-005227b1-93f3-42b7-bf7d-7a4b92a7d067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc302fd8-397a-45ed-9316-d78c9f5b324a", "name": "network-vif-plugged", "status": "completed", "tag": "fbd1d709-759c-4885-a8dc-e6d908c97d61"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:09.365023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-557d8019-6838-4074-9f4a-4e1d0ba162fc req-005227b1-93f3-42b7-bf7d-7a4b92a7d067 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:09.367329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-557d8019-6838-4074-9f4a-4e1d0ba162fc req-005227b1-93f3-42b7-bf7d-7a4b92a7d067 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:09.378157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-557d8019-6838-4074-9f4a-4e1d0ba162fc req-005227b1-93f3-42b7-bf7d-7a4b92a7d067 service nova] Creating event network-vif-plugged:fbd1d709-759c-4885-a8dc-e6d908c97d61 for instance fc302fd8-397a-45ed-9316-d78c9f5b324a on hv-cinder-79760 Jun 02 16:07:09.384095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-557d8019-6838-4074-9f4a-4e1d0ba162fc req-005227b1-93f3-42b7-bf7d-7a4b92a7d067 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030273 Jun 02 16:07:09.384901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 51/101] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:07:09.437303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1c4dfc9d-1bd5-4d20-be22-7666358ddfa7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:09.437974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1c4dfc9d-1bd5-4d20-be22-7666358ddfa7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:09.444043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1c4dfc9d-1bd5-4d20-be22-7666358ddfa7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:09.444481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1c4dfc9d-1bd5-4d20-be22-7666358ddfa7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:09.447332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1c4dfc9d-1bd5-4d20-be22-7666358ddfa7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:09.447332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1c4dfc9d-1bd5-4d20-be22-7666358ddfa7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:09.449891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:09.595019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1c4dfc9d-1bd5-4d20-be22-7666358ddfa7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:09.603831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1c4dfc9d-1bd5-4d20-be22-7666358ddfa7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.169994 Jun 02 16:07:09.604312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 51/102] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:09 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:09.769946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:09.769946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-754e4693-5cd6-418e-b701-c094537a9de7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:09.769946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-754e4693-5cd6-418e-b701-c094537a9de7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:09.772255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-754e4693-5cd6-418e-b701-c094537a9de7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:09.772919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-754e4693-5cd6-418e-b701-c094537a9de7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:09.773755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-754e4693-5cd6-418e-b701-c094537a9de7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:09.774880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-754e4693-5cd6-418e-b701-c094537a9de7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:09.920934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-754e4693-5cd6-418e-b701-c094537a9de7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:09.928238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-754e4693-5cd6-418e-b701-c094537a9de7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.169989 Jun 02 16:07:09.928796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 52/103] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:09 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:10.343244 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-63dc4ef1-cc3e-4f18-b9ca-83920f85a0c0 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:10.344571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-63dc4ef1-cc3e-4f18-b9ca-83920f85a0c0 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:10.351961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63dc4ef1-cc3e-4f18-b9ca-83920f85a0c0 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:10.353116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63dc4ef1-cc3e-4f18-b9ca-83920f85a0c0 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:10.360255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63dc4ef1-cc3e-4f18-b9ca-83920f85a0c0 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:10.360255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63dc4ef1-cc3e-4f18-b9ca-83920f85a0c0 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:10.597876 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-63dc4ef1-cc3e-4f18-b9ca-83920f85a0c0 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:10.606572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-63dc4ef1-cc3e-4f18-b9ca-83920f85a0c0 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.266993 Jun 02 16:07:10.607738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 52/104] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:10 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:10.623446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5373d4f5-d244-47e5-b5ca-1b2cd31cfe6d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:10.624913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5373d4f5-d244-47e5-b5ca-1b2cd31cfe6d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:10.631809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5373d4f5-d244-47e5-b5ca-1b2cd31cfe6d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:10.632437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5373d4f5-d244-47e5-b5ca-1b2cd31cfe6d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:10.634194 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5373d4f5-d244-47e5-b5ca-1b2cd31cfe6d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:10.635075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5373d4f5-d244-47e5-b5ca-1b2cd31cfe6d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:10.860041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5373d4f5-d244-47e5-b5ca-1b2cd31cfe6d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:10.869074 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5373d4f5-d244-47e5-b5ca-1b2cd31cfe6d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.251042 Jun 02 16:07:10.876059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 53/105] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:10 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:10.946398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b4cca52d-512f-4ecf-85d9-3d676641fb4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:10.947019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b4cca52d-512f-4ecf-85d9-3d676641fb4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:10.954067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4cca52d-512f-4ecf-85d9-3d676641fb4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:10.954763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4cca52d-512f-4ecf-85d9-3d676641fb4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:10.955528 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4cca52d-512f-4ecf-85d9-3d676641fb4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:10.955959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4cca52d-512f-4ecf-85d9-3d676641fb4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:11.310852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b4cca52d-512f-4ecf-85d9-3d676641fb4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:11.321767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b4cca52d-512f-4ecf-85d9-3d676641fb4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.379093 Jun 02 16:07:11.322445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 53/106] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:10 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:11.625836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a046904c-44b4-4bdc-80a3-975ec07cadfd tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:11.627400 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a046904c-44b4-4bdc-80a3-975ec07cadfd tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:11.637825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a046904c-44b4-4bdc-80a3-975ec07cadfd tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:11.638377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a046904c-44b4-4bdc-80a3-975ec07cadfd tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:11.639371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a046904c-44b4-4bdc-80a3-975ec07cadfd tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:11.640720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a046904c-44b4-4bdc-80a3-975ec07cadfd tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:11.791698 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a046904c-44b4-4bdc-80a3-975ec07cadfd tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:11.799749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a046904c-44b4-4bdc-80a3-975ec07cadfd tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1315 microversion: 2.1 time: 0.178363 Jun 02 16:07:11.800621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 54/107] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:11 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:11.889180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-beeb9791-b217-4ad8-a72d-1cd14a93b31d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:11.895446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-beeb9791-b217-4ad8-a72d-1cd14a93b31d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:11.899443 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-beeb9791-b217-4ad8-a72d-1cd14a93b31d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:11.899895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-beeb9791-b217-4ad8-a72d-1cd14a93b31d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:11.900918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-beeb9791-b217-4ad8-a72d-1cd14a93b31d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:11.901544 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-beeb9791-b217-4ad8-a72d-1cd14a93b31d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:12.065876 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-beeb9791-b217-4ad8-a72d-1cd14a93b31d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:12.068130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-beeb9791-b217-4ad8-a72d-1cd14a93b31d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.186382 Jun 02 16:07:12.068700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 54/108] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:11 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:12.339474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4c1a333d-8ff7-470f-970a-1cf56a93cd3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:12.340119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4c1a333d-8ff7-470f-970a-1cf56a93cd3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:12.346144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c1a333d-8ff7-470f-970a-1cf56a93cd3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:12.346596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c1a333d-8ff7-470f-970a-1cf56a93cd3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:12.347361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c1a333d-8ff7-470f-970a-1cf56a93cd3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:12.347796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c1a333d-8ff7-470f-970a-1cf56a93cd3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:12.481634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4c1a333d-8ff7-470f-970a-1cf56a93cd3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:12.489298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4c1a333d-8ff7-470f-970a-1cf56a93cd3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.154424 Jun 02 16:07:12.489870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 55/109] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:12 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:12.818217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-68cd6b15-2c90-432e-b662-33a5c48c273c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:12.818831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-68cd6b15-2c90-432e-b662-33a5c48c273c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:12.825453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-68cd6b15-2c90-432e-b662-33a5c48c273c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:12.825893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-68cd6b15-2c90-432e-b662-33a5c48c273c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:12.826892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-68cd6b15-2c90-432e-b662-33a5c48c273c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:12.827333 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-68cd6b15-2c90-432e-b662-33a5c48c273c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:12.964581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-68cd6b15-2c90-432e-b662-33a5c48c273c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:12.972200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-68cd6b15-2c90-432e-b662-33a5c48c273c tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1503 microversion: 2.1 time: 0.157899 Jun 02 16:07:12.972790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 55/110] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:12 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:13.088910 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c0fc13be-1063-40ac-b72e-7afdd7e5d27c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:13.088910 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c0fc13be-1063-40ac-b72e-7afdd7e5d27c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:13.095269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0fc13be-1063-40ac-b72e-7afdd7e5d27c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:13.095876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0fc13be-1063-40ac-b72e-7afdd7e5d27c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:13.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0fc13be-1063-40ac-b72e-7afdd7e5d27c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:13.098098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0fc13be-1063-40ac-b72e-7afdd7e5d27c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:13.254508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c0fc13be-1063-40ac-b72e-7afdd7e5d27c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:13.266920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c0fc13be-1063-40ac-b72e-7afdd7e5d27c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.185105 Jun 02 16:07:13.267759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 56/111] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:13 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:13.473957 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-e9bc7de9-5b60-4acf-836a-c48e959306e6 req-f9528563-4903-420f-9b18-203208824f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d2a6ab-d9d6-4043-90ae-76da9f639df4", "name": "network-vif-plugged", "status": "completed", "tag": "f0173a42-e08a-48e6-a40a-dd060bef661a"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:13.489086 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e9bc7de9-5b60-4acf-836a-c48e959306e6 req-f9528563-4903-420f-9b18-203208824f0b service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:13.489620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e9bc7de9-5b60-4acf-836a-c48e959306e6 req-f9528563-4903-420f-9b18-203208824f0b service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:13.502766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-e9bc7de9-5b60-4acf-836a-c48e959306e6 req-f9528563-4903-420f-9b18-203208824f0b service nova] Creating event network-vif-plugged:f0173a42-e08a-48e6-a40a-dd060bef661a for instance 38d2a6ab-d9d6-4043-90ae-76da9f639df4 on hv-cinder-79760 Jun 02 16:07:13.507223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6c50a93d-c36a-4b34-b771-4aa3b115d34e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:13.508074 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6c50a93d-c36a-4b34-b771-4aa3b115d34e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:13.510326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-e9bc7de9-5b60-4acf-836a-c48e959306e6 req-f9528563-4903-420f-9b18-203208824f0b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042610 Jun 02 16:07:13.515394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 56/112] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:07:13.518733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6c50a93d-c36a-4b34-b771-4aa3b115d34e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:13.522776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6c50a93d-c36a-4b34-b771-4aa3b115d34e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:13.523590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6c50a93d-c36a-4b34-b771-4aa3b115d34e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:13.525057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6c50a93d-c36a-4b34-b771-4aa3b115d34e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:13.694867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6c50a93d-c36a-4b34-b771-4aa3b115d34e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:13.704279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6c50a93d-c36a-4b34-b771-4aa3b115d34e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.201010 Jun 02 16:07:13.704952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 57/113] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:13 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:14.299584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8f3838d4-7964-49a2-b177-0ade6f6eb1c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:14.299584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8f3838d4-7964-49a2-b177-0ade6f6eb1c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:14.308065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8f3838d4-7964-49a2-b177-0ade6f6eb1c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:14.308660 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8f3838d4-7964-49a2-b177-0ade6f6eb1c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:14.309606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8f3838d4-7964-49a2-b177-0ade6f6eb1c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:14.312211 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8f3838d4-7964-49a2-b177-0ade6f6eb1c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:14.510389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8f3838d4-7964-49a2-b177-0ade6f6eb1c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:14.518849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8f3838d4-7964-49a2-b177-0ade6f6eb1c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.237434 Jun 02 16:07:14.519630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 57/114] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:14 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:14.722155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fea47f6a-b67a-44e8-a25a-01fce2bb5d3f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:14.722966 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fea47f6a-b67a-44e8-a25a-01fce2bb5d3f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:14.729823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fea47f6a-b67a-44e8-a25a-01fce2bb5d3f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:14.730294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fea47f6a-b67a-44e8-a25a-01fce2bb5d3f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:14.731056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fea47f6a-b67a-44e8-a25a-01fce2bb5d3f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:14.731564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fea47f6a-b67a-44e8-a25a-01fce2bb5d3f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:14.866441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fea47f6a-b67a-44e8-a25a-01fce2bb5d3f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:14.880106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fea47f6a-b67a-44e8-a25a-01fce2bb5d3f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.161978 Jun 02 16:07:14.882885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 58/115] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:14 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:15.536964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d3f92b7e-bfd6-47a4-b5e1-0a0885735e31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:15.537610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d3f92b7e-bfd6-47a4-b5e1-0a0885735e31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:15.544608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3f92b7e-bfd6-47a4-b5e1-0a0885735e31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:15.545057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3f92b7e-bfd6-47a4-b5e1-0a0885735e31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:15.545828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3f92b7e-bfd6-47a4-b5e1-0a0885735e31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:15.546302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3f92b7e-bfd6-47a4-b5e1-0a0885735e31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:15.676349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d3f92b7e-bfd6-47a4-b5e1-0a0885735e31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:15.685115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d3f92b7e-bfd6-47a4-b5e1-0a0885735e31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.152034 Jun 02 16:07:15.686108 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 58/116] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:15 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:15.898668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-909c5946-54f3-466e-8d96-cd079750e529 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:15.900573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-909c5946-54f3-466e-8d96-cd079750e529 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:15.906790 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-909c5946-54f3-466e-8d96-cd079750e529 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:15.907243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-909c5946-54f3-466e-8d96-cd079750e529 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:15.908011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-909c5946-54f3-466e-8d96-cd079750e529 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:15.908620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-909c5946-54f3-466e-8d96-cd079750e529 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:15.936394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-07f32e85-5db7-4ffa-8398-ab73a0b5b556 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a215a403-f57c-4621-928a-3e1956f5b204"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:15.938235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-07f32e85-5db7-4ffa-8398-ab73a0b5b556 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:15.944874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07f32e85-5db7-4ffa-8398-ab73a0b5b556 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:15.946504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07f32e85-5db7-4ffa-8398-ab73a0b5b556 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:15.947493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07f32e85-5db7-4ffa-8398-ab73a0b5b556 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:15.948023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07f32e85-5db7-4ffa-8398-ab73a0b5b556 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:16.111362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-909c5946-54f3-466e-8d96-cd079750e529 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:16.121047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-909c5946-54f3-466e-8d96-cd079750e529 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.227006 Jun 02 16:07:16.122121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 59/117] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:15 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:16.701725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-33430ff6-d5b6-427d-ac02-a3f208d9b56f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:16.702363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-33430ff6-d5b6-427d-ac02-a3f208d9b56f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:16.708858 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33430ff6-d5b6-427d-ac02-a3f208d9b56f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:16.709318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33430ff6-d5b6-427d-ac02-a3f208d9b56f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:16.710102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33430ff6-d5b6-427d-ac02-a3f208d9b56f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:16.710534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33430ff6-d5b6-427d-ac02-a3f208d9b56f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:16.841372 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-33430ff6-d5b6-427d-ac02-a3f208d9b56f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:16.849260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-33430ff6-d5b6-427d-ac02-a3f208d9b56f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.151377 Jun 02 16:07:16.849831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 60/118] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:16 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:17.141922 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e82793ca-f1bf-418c-98e2-ed448dbf67be tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:17.142727 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e82793ca-f1bf-418c-98e2-ed448dbf67be tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:17.150212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e82793ca-f1bf-418c-98e2-ed448dbf67be tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:17.150753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e82793ca-f1bf-418c-98e2-ed448dbf67be tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:17.151694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e82793ca-f1bf-418c-98e2-ed448dbf67be tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:17.152361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e82793ca-f1bf-418c-98e2-ed448dbf67be tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:17.311887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e82793ca-f1bf-418c-98e2-ed448dbf67be tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:17.319751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e82793ca-f1bf-418c-98e2-ed448dbf67be tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1321 microversion: 2.1 time: 0.182431 Jun 02 16:07:17.320327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 61/119] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:17 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:17.867217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7c528d6e-9b68-4438-8657-fad4bd13c072 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:17.868761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7c528d6e-9b68-4438-8657-fad4bd13c072 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:17.875491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c528d6e-9b68-4438-8657-fad4bd13c072 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:17.875945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c528d6e-9b68-4438-8657-fad4bd13c072 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:17.876716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c528d6e-9b68-4438-8657-fad4bd13c072 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:17.877151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c528d6e-9b68-4438-8657-fad4bd13c072 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:18.010484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7c528d6e-9b68-4438-8657-fad4bd13c072 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:18.018032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7c528d6e-9b68-4438-8657-fad4bd13c072 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.154805 Jun 02 16:07:18.021848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 62/120] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:17 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:18.338170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7fb5bfae-0017-4f8d-ae8a-33b2ff825d79 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:18.338795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7fb5bfae-0017-4f8d-ae8a-33b2ff825d79 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:18.344766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7fb5bfae-0017-4f8d-ae8a-33b2ff825d79 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:18.345205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7fb5bfae-0017-4f8d-ae8a-33b2ff825d79 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:18.345957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7fb5bfae-0017-4f8d-ae8a-33b2ff825d79 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:18.346494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7fb5bfae-0017-4f8d-ae8a-33b2ff825d79 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:18.376529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-07f32e85-5db7-4ffa-8398-ab73a0b5b556 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "POST /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.444731 Jun 02 16:07:18.377159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 59/121] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:07:15 2022] POST /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775/os-volume_attachments => generated 194 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:07:18.475596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7fb5bfae-0017-4f8d-ae8a-33b2ff825d79 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:18.483389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7fb5bfae-0017-4f8d-ae8a-33b2ff825d79 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1515 microversion: 2.1 time: 0.150011 Jun 02 16:07:18.491430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 63/122] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:18 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:18.500801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a04d7f20-220d-4c98-a293-13c375bf0703 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:18.501876 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a04d7f20-220d-4c98-a293-13c375bf0703 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:18.508150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a04d7f20-220d-4c98-a293-13c375bf0703 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:18.509067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a04d7f20-220d-4c98-a293-13c375bf0703 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:18.509900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a04d7f20-220d-4c98-a293-13c375bf0703 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:18.510361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a04d7f20-220d-4c98-a293-13c375bf0703 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:18.534468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-a04d7f20-220d-4c98-a293-13c375bf0703 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lazy-loading 'flavor' on Instance uuid 38d2a6ab-d9d6-4043-90ae-76da9f639df4 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:07:19.005195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a04d7f20-220d-4c98-a293-13c375bf0703 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4/action" status: 200 len: 32 microversion: 2.1 time: 0.508608 Jun 02 16:07:19.005849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 60/123] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:07:18 2022] POST /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4/action => generated 32 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 16:07:19.015580 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-05b3aa69-29fe-48ff-96b5-18a02913bb25 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:19.016161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-05b3aa69-29fe-48ff-96b5-18a02913bb25 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:19.022256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-05b3aa69-29fe-48ff-96b5-18a02913bb25 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:19.022695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-05b3aa69-29fe-48ff-96b5-18a02913bb25 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:19.023443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-05b3aa69-29fe-48ff-96b5-18a02913bb25 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:19.023896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-05b3aa69-29fe-48ff-96b5-18a02913bb25 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:19.036067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b6345325-6abb-4d18-b890-a565e17c9a29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:19.036904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b6345325-6abb-4d18-b890-a565e17c9a29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:19.044090 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6345325-6abb-4d18-b890-a565e17c9a29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:19.044695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6345325-6abb-4d18-b890-a565e17c9a29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:19.045363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6345325-6abb-4d18-b890-a565e17c9a29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:19.045802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6345325-6abb-4d18-b890-a565e17c9a29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:19.160281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-05b3aa69-29fe-48ff-96b5-18a02913bb25 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:19.170666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-05b3aa69-29fe-48ff-96b5-18a02913bb25 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.158778 Jun 02 16:07:19.177394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 64/124] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:19 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:19.199306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b6345325-6abb-4d18-b890-a565e17c9a29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:19.207156 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b6345325-6abb-4d18-b890-a565e17c9a29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.175225 Jun 02 16:07:19.207724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 61/125] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:19 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:20.189643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-db3459be-4a94-4ed5-b5c0-05e72c501e9d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:20.190865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-db3459be-4a94-4ed5-b5c0-05e72c501e9d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:20.198416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-db3459be-4a94-4ed5-b5c0-05e72c501e9d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:20.199112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-db3459be-4a94-4ed5-b5c0-05e72c501e9d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:20.200098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-db3459be-4a94-4ed5-b5c0-05e72c501e9d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:20.200706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-db3459be-4a94-4ed5-b5c0-05e72c501e9d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:20.224682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-76d2ffe7-a92e-46f4-84cc-3044009d3481 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:20.225300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-76d2ffe7-a92e-46f4-84cc-3044009d3481 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:20.232330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76d2ffe7-a92e-46f4-84cc-3044009d3481 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:20.232789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76d2ffe7-a92e-46f4-84cc-3044009d3481 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:20.233560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76d2ffe7-a92e-46f4-84cc-3044009d3481 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:20.237397 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76d2ffe7-a92e-46f4-84cc-3044009d3481 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:20.334436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-db3459be-4a94-4ed5-b5c0-05e72c501e9d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:20.342139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-db3459be-4a94-4ed5-b5c0-05e72c501e9d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.156308 Jun 02 16:07:20.342704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 65/126] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:20 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:20.370422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-76d2ffe7-a92e-46f4-84cc-3044009d3481 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:20.380473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-76d2ffe7-a92e-46f4-84cc-3044009d3481 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.157659 Jun 02 16:07:20.380473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 62/127] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:20 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:21.360487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2efa9838-64ea-4e5f-a5c8-7d72b9d25887 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:21.361103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2efa9838-64ea-4e5f-a5c8-7d72b9d25887 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:21.367579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2efa9838-64ea-4e5f-a5c8-7d72b9d25887 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:21.368031 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2efa9838-64ea-4e5f-a5c8-7d72b9d25887 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:21.368796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2efa9838-64ea-4e5f-a5c8-7d72b9d25887 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:21.369487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2efa9838-64ea-4e5f-a5c8-7d72b9d25887 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:21.396423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6551fdce-693e-4874-ab2e-33243df55c9a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:21.397034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6551fdce-693e-4874-ab2e-33243df55c9a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:21.404316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6551fdce-693e-4874-ab2e-33243df55c9a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:21.404760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6551fdce-693e-4874-ab2e-33243df55c9a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:21.405520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6551fdce-693e-4874-ab2e-33243df55c9a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:21.406000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6551fdce-693e-4874-ab2e-33243df55c9a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:21.504561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2efa9838-64ea-4e5f-a5c8-7d72b9d25887 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:21.520570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2efa9838-64ea-4e5f-a5c8-7d72b9d25887 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.163817 Jun 02 16:07:21.521178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 66/128] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:21 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:21.538775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6551fdce-693e-4874-ab2e-33243df55c9a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:21.546264 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6551fdce-693e-4874-ab2e-33243df55c9a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.153511 Jun 02 16:07:21.546819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 63/129] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:21 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:22.538224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cee0db17-a1d6-4853-a75a-efbbbfd0bf02 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:22.538816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cee0db17-a1d6-4853-a75a-efbbbfd0bf02 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:22.545547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cee0db17-a1d6-4853-a75a-efbbbfd0bf02 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:22.545989 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cee0db17-a1d6-4853-a75a-efbbbfd0bf02 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:22.547051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cee0db17-a1d6-4853-a75a-efbbbfd0bf02 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:22.547486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cee0db17-a1d6-4853-a75a-efbbbfd0bf02 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:22.563161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d1ed1037-52d1-44f1-a8e0-3d90058336f1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:22.563893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d1ed1037-52d1-44f1-a8e0-3d90058336f1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:22.570654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d1ed1037-52d1-44f1-a8e0-3d90058336f1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:22.571101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d1ed1037-52d1-44f1-a8e0-3d90058336f1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:22.571976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d1ed1037-52d1-44f1-a8e0-3d90058336f1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:22.572418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d1ed1037-52d1-44f1-a8e0-3d90058336f1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:22.682427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cee0db17-a1d6-4853-a75a-efbbbfd0bf02 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:22.690114 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cee0db17-a1d6-4853-a75a-efbbbfd0bf02 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.155680 Jun 02 16:07:22.690697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 67/130] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:22 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:22.711891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d1ed1037-52d1-44f1-a8e0-3d90058336f1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:22.719913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d1ed1037-52d1-44f1-a8e0-3d90058336f1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.160561 Jun 02 16:07:22.720499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 64/131] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:22 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:23.125281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-13ec0cf1-168c-4f19-b44f-9fe2b9a99139 req-f522f517-f0e6-4bfc-90ca-f6c83a373e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90430f1e-1a79-4ab9-b7f7-c44ee8c064d5", "name": "network-vif-plugged", "status": "completed", "tag": "ef63a7f5-6a5e-4b24-a830-c7caf3ad05ec"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:23.135890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-13ec0cf1-168c-4f19-b44f-9fe2b9a99139 req-f522f517-f0e6-4bfc-90ca-f6c83a373e52 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:23.136449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-13ec0cf1-168c-4f19-b44f-9fe2b9a99139 req-f522f517-f0e6-4bfc-90ca-f6c83a373e52 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:23.139269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:23.148688 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-13ec0cf1-168c-4f19-b44f-9fe2b9a99139 req-f522f517-f0e6-4bfc-90ca-f6c83a373e52 service nova] Creating event network-vif-plugged:ef63a7f5-6a5e-4b24-a830-c7caf3ad05ec for instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 on hv-cinder-79760 Jun 02 16:07:23.154438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-13ec0cf1-168c-4f19-b44f-9fe2b9a99139 req-f522f517-f0e6-4bfc-90ca-f6c83a373e52 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033135 Jun 02 16:07:23.155110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 68/132] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:07:23.706861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9551d5ed-4d44-4707-b457-71732c49198d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:23.707476 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9551d5ed-4d44-4707-b457-71732c49198d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:23.715178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9551d5ed-4d44-4707-b457-71732c49198d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:23.715958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9551d5ed-4d44-4707-b457-71732c49198d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:23.716736 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9551d5ed-4d44-4707-b457-71732c49198d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:23.717169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9551d5ed-4d44-4707-b457-71732c49198d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:23.720000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:23.906403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-23d05fc3-afe2-4e49-a9e6-39238a9f8bc3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:23.906403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-23d05fc3-afe2-4e49-a9e6-39238a9f8bc3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:23.906403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23d05fc3-afe2-4e49-a9e6-39238a9f8bc3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:23.906403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23d05fc3-afe2-4e49-a9e6-39238a9f8bc3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:23.907825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23d05fc3-afe2-4e49-a9e6-39238a9f8bc3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:23.907825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23d05fc3-afe2-4e49-a9e6-39238a9f8bc3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:23.907825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-23d05fc3-afe2-4e49-a9e6-39238a9f8bc3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:23.908050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-23d05fc3-afe2-4e49-a9e6-39238a9f8bc3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.166243 Jun 02 16:07:23.908050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 69/133] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:23 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:24.140649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9551d5ed-4d44-4707-b457-71732c49198d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:24.148361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9551d5ed-4d44-4707-b457-71732c49198d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.445308 Jun 02 16:07:24.148958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 65/134] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:23 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:24.919169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-31a5c713-6f6c-44aa-8ded-cee5d1155f2a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:24.919926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-31a5c713-6f6c-44aa-8ded-cee5d1155f2a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:24.926686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31a5c713-6f6c-44aa-8ded-cee5d1155f2a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:24.927139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31a5c713-6f6c-44aa-8ded-cee5d1155f2a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:24.927915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31a5c713-6f6c-44aa-8ded-cee5d1155f2a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:24.928351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31a5c713-6f6c-44aa-8ded-cee5d1155f2a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:25.066793 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-31a5c713-6f6c-44aa-8ded-cee5d1155f2a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:25.075256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-31a5c713-6f6c-44aa-8ded-cee5d1155f2a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.160286 Jun 02 16:07:25.075885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 70/135] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:24 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:25.170170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-407704f0-4a0c-44e6-8d3e-35d3e9f5ad4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:25.171007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-407704f0-4a0c-44e6-8d3e-35d3e9f5ad4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:25.178345 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-407704f0-4a0c-44e6-8d3e-35d3e9f5ad4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:25.178873 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-407704f0-4a0c-44e6-8d3e-35d3e9f5ad4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:25.179636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-407704f0-4a0c-44e6-8d3e-35d3e9f5ad4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:25.180067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-407704f0-4a0c-44e6-8d3e-35d3e9f5ad4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:25.324116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-407704f0-4a0c-44e6-8d3e-35d3e9f5ad4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:25.331514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-407704f0-4a0c-44e6-8d3e-35d3e9f5ad4f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.166060 Jun 02 16:07:25.333403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 66/136] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:25 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:26.093363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-558b4911-63b9-4bfd-bd2b-a9a0ac576928 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:26.102862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-558b4911-63b9-4bfd-bd2b-a9a0ac576928 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:26.109281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-558b4911-63b9-4bfd-bd2b-a9a0ac576928 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:26.109728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-558b4911-63b9-4bfd-bd2b-a9a0ac576928 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:26.110620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-558b4911-63b9-4bfd-bd2b-a9a0ac576928 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:26.111049 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-558b4911-63b9-4bfd-bd2b-a9a0ac576928 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:26.246394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-558b4911-63b9-4bfd-bd2b-a9a0ac576928 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:26.254429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-558b4911-63b9-4bfd-bd2b-a9a0ac576928 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1362 microversion: 2.1 time: 0.164962 Jun 02 16:07:26.255321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 71/137] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:26 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:26.352476 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e98d99d7-35da-48f4-82a6-964b474584e8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:26.360839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e98d99d7-35da-48f4-82a6-964b474584e8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:26.365855 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e98d99d7-35da-48f4-82a6-964b474584e8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:26.366378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e98d99d7-35da-48f4-82a6-964b474584e8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:26.367844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e98d99d7-35da-48f4-82a6-964b474584e8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:26.368279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e98d99d7-35da-48f4-82a6-964b474584e8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:26.524403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e98d99d7-35da-48f4-82a6-964b474584e8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:26.532318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e98d99d7-35da-48f4-82a6-964b474584e8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.186696 Jun 02 16:07:26.532886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 67/138] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:26 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:27.276246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b76ee08f-7190-4a6e-8105-d54c300c8ecc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:27.276960 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b76ee08f-7190-4a6e-8105-d54c300c8ecc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:27.282982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b76ee08f-7190-4a6e-8105-d54c300c8ecc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:27.283422 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b76ee08f-7190-4a6e-8105-d54c300c8ecc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:27.284335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b76ee08f-7190-4a6e-8105-d54c300c8ecc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:27.284915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b76ee08f-7190-4a6e-8105-d54c300c8ecc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:27.469968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b76ee08f-7190-4a6e-8105-d54c300c8ecc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:27.480852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b76ee08f-7190-4a6e-8105-d54c300c8ecc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1547 microversion: 2.1 time: 0.206166 Jun 02 16:07:27.480852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 72/139] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:27 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1547 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:27.497323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ed3d5f74-7ae4-43ca-93be-e31ffd415ac3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:27.498212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ed3d5f74-7ae4-43ca-93be-e31ffd415ac3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:27.505548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ed3d5f74-7ae4-43ca-93be-e31ffd415ac3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:27.506189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ed3d5f74-7ae4-43ca-93be-e31ffd415ac3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:27.507104 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ed3d5f74-7ae4-43ca-93be-e31ffd415ac3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:27.507827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ed3d5f74-7ae4-43ca-93be-e31ffd415ac3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:27.548938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-347d1e1d-4eac-41b1-bf45-6a561eb7d40a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:27.549549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-347d1e1d-4eac-41b1-bf45-6a561eb7d40a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:27.556292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-347d1e1d-4eac-41b1-bf45-6a561eb7d40a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:27.557013 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-347d1e1d-4eac-41b1-bf45-6a561eb7d40a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:27.557856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-347d1e1d-4eac-41b1-bf45-6a561eb7d40a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:27.558389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-347d1e1d-4eac-41b1-bf45-6a561eb7d40a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:27.595326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ed3d5f74-7ae4-43ca-93be-e31ffd415ac3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102893 Jun 02 16:07:27.595915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 68/140] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 2 16:07:27 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:07:27.701828 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-347d1e1d-4eac-41b1-bf45-6a561eb7d40a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:27.711318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-347d1e1d-4eac-41b1-bf45-6a561eb7d40a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.166184 Jun 02 16:07:27.712309 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 73/141] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:27 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:28.730891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-231d5b97-deb8-462e-a360-de22960e0419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:28.732260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-231d5b97-deb8-462e-a360-de22960e0419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:28.741133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=72 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:28.751564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-231d5b97-deb8-462e-a360-de22960e0419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:28.751564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-231d5b97-deb8-462e-a360-de22960e0419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:28.751564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-231d5b97-deb8-462e-a360-de22960e0419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:28.752122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-231d5b97-deb8-462e-a360-de22960e0419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:29.076933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-231d5b97-deb8-462e-a360-de22960e0419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:29.088255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-231d5b97-deb8-462e-a360-de22960e0419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.362828 Jun 02 16:07:29.101671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 69/142] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:28 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:29.196089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-b365cd27-009b-463b-9fcc-006bcc284d82 req-b3aee839-3980-404a-a3c8-0b48b451d2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90430f1e-1a79-4ab9-b7f7-c44ee8c064d5", "tag": "ef63a7f5-6a5e-4b24-a830-c7caf3ad05ec"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:29.204607 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=82 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:29.206821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-b365cd27-009b-463b-9fcc-006bcc284d82 req-b3aee839-3980-404a-a3c8-0b48b451d2fb service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:29.207325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-b365cd27-009b-463b-9fcc-006bcc284d82 req-b3aee839-3980-404a-a3c8-0b48b451d2fb service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:29.222764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-b365cd27-009b-463b-9fcc-006bcc284d82 req-b3aee839-3980-404a-a3c8-0b48b451d2fb service nova] Creating event network-changed:ef63a7f5-6a5e-4b24-a830-c7caf3ad05ec for instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 on hv-cinder-79760 Jun 02 16:07:29.226834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-b365cd27-009b-463b-9fcc-006bcc284d82 req-b3aee839-3980-404a-a3c8-0b48b451d2fb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034466 Jun 02 16:07:29.232950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 74/143] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:07:30.120429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-96997d7f-6665-41cd-95b3-b103ea4f9232 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:30.121151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-96997d7f-6665-41cd-95b3-b103ea4f9232 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:30.141911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96997d7f-6665-41cd-95b3-b103ea4f9232 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:30.142463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96997d7f-6665-41cd-95b3-b103ea4f9232 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:30.143837 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96997d7f-6665-41cd-95b3-b103ea4f9232 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:30.145029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96997d7f-6665-41cd-95b3-b103ea4f9232 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:30.362251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-96997d7f-6665-41cd-95b3-b103ea4f9232 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:30.371150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-96997d7f-6665-41cd-95b3-b103ea4f9232 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.257025 Jun 02 16:07:30.380354 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 70/144] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:30 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:31.389917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6aa3ea6d-4fd2-4be8-a7dc-ddedecdd1df3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:31.390680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6aa3ea6d-4fd2-4be8-a7dc-ddedecdd1df3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:31.399839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6aa3ea6d-4fd2-4be8-a7dc-ddedecdd1df3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:31.401032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6aa3ea6d-4fd2-4be8-a7dc-ddedecdd1df3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:31.402044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6aa3ea6d-4fd2-4be8-a7dc-ddedecdd1df3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:31.402504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6aa3ea6d-4fd2-4be8-a7dc-ddedecdd1df3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:31.659606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6aa3ea6d-4fd2-4be8-a7dc-ddedecdd1df3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:31.668257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6aa3ea6d-4fd2-4be8-a7dc-ddedecdd1df3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.283367 Jun 02 16:07:31.677673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 75/145] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:31 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:32.685230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-507344a0-913c-4c81-8960-f531a2dad55a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:32.686114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-507344a0-913c-4c81-8960-f531a2dad55a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:32.698501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-507344a0-913c-4c81-8960-f531a2dad55a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:32.698754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-507344a0-913c-4c81-8960-f531a2dad55a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:32.699591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-507344a0-913c-4c81-8960-f531a2dad55a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:32.700124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-507344a0-913c-4c81-8960-f531a2dad55a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:32.863461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-507344a0-913c-4c81-8960-f531a2dad55a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:32.871752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-507344a0-913c-4c81-8960-f531a2dad55a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.190906 Jun 02 16:07:32.872332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 71/146] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:32 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:33.893635 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-62a41c22-d5d6-443e-b07b-10344ad5a2cf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:33.894438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-62a41c22-d5d6-443e-b07b-10344ad5a2cf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:33.901670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62a41c22-d5d6-443e-b07b-10344ad5a2cf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:33.902361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62a41c22-d5d6-443e-b07b-10344ad5a2cf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:33.903207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62a41c22-d5d6-443e-b07b-10344ad5a2cf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:33.903722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62a41c22-d5d6-443e-b07b-10344ad5a2cf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:33.964862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ec28fddd-187b-4550-8fb2-a8ca3fb3326a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:33.965962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ec28fddd-187b-4550-8fb2-a8ca3fb3326a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:33.972537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ec28fddd-187b-4550-8fb2-a8ca3fb3326a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:33.973042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ec28fddd-187b-4550-8fb2-a8ca3fb3326a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:33.973903 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ec28fddd-187b-4550-8fb2-a8ca3fb3326a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:33.974372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ec28fddd-187b-4550-8fb2-a8ca3fb3326a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:34.000786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ec28fddd-187b-4550-8fb2-a8ca3fb3326a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Going to try to terminate instance {{(pid=118257) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:07:34.040153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-62a41c22-d5d6-443e-b07b-10344ad5a2cf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:34.048724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-62a41c22-d5d6-443e-b07b-10344ad5a2cf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.159843 Jun 02 16:07:34.049487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 76/147] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:33 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:34.544084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ec28fddd-187b-4550-8fb2-a8ca3fb3326a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 204 len: 0 microversion: 2.1 time: 0.583249 Jun 02 16:07:34.544683 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 72/148] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:07:33 2022] DELETE /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:07:34.552955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9d9f18e3-6ac5-4387-b21e-645d9f31ec23 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:34.553487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9d9f18e3-6ac5-4387-b21e-645d9f31ec23 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:34.559464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d9f18e3-6ac5-4387-b21e-645d9f31ec23 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:34.559898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d9f18e3-6ac5-4387-b21e-645d9f31ec23 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:34.560947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d9f18e3-6ac5-4387-b21e-645d9f31ec23 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:34.561373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d9f18e3-6ac5-4387-b21e-645d9f31ec23 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:34.705870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9d9f18e3-6ac5-4387-b21e-645d9f31ec23 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:34.720680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9d9f18e3-6ac5-4387-b21e-645d9f31ec23 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1555 microversion: 2.1 time: 0.171360 Jun 02 16:07:34.722553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 77/149] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:34 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:35.085211 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-38498bce-b432-49c2-b263-cb17fc9149e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:35.088495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-38498bce-b432-49c2-b263-cb17fc9149e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:35.112558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38498bce-b432-49c2-b263-cb17fc9149e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:35.113268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38498bce-b432-49c2-b263-cb17fc9149e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:35.115910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38498bce-b432-49c2-b263-cb17fc9149e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:35.116560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38498bce-b432-49c2-b263-cb17fc9149e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:35.280249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-38498bce-b432-49c2-b263-cb17fc9149e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:35.285696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-38498bce-b432-49c2-b263-cb17fc9149e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.206792 Jun 02 16:07:35.286419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 73/150] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:35 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:35.738475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7d9ebfd8-5805-4808-8af7-6a664b51a7ba tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:35.739087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7d9ebfd8-5805-4808-8af7-6a664b51a7ba tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:35.745853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7d9ebfd8-5805-4808-8af7-6a664b51a7ba tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:35.746320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7d9ebfd8-5805-4808-8af7-6a664b51a7ba tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:35.747274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7d9ebfd8-5805-4808-8af7-6a664b51a7ba tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:35.747884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7d9ebfd8-5805-4808-8af7-6a664b51a7ba tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:35.907999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7d9ebfd8-5805-4808-8af7-6a664b51a7ba tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:35.916397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7d9ebfd8-5805-4808-8af7-6a664b51a7ba tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1555 microversion: 2.1 time: 0.181469 Jun 02 16:07:35.917102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 78/151] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:35 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:36.304098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-91639cc6-51d0-404a-a2e2-cd669e279fef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:36.305690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-91639cc6-51d0-404a-a2e2-cd669e279fef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:36.315993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91639cc6-51d0-404a-a2e2-cd669e279fef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:36.316515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91639cc6-51d0-404a-a2e2-cd669e279fef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:36.317436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91639cc6-51d0-404a-a2e2-cd669e279fef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:36.317880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91639cc6-51d0-404a-a2e2-cd669e279fef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:36.481095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-91639cc6-51d0-404a-a2e2-cd669e279fef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:36.489499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-91639cc6-51d0-404a-a2e2-cd669e279fef tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.190026 Jun 02 16:07:36.500340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 74/152] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:36 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:36.933986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d5bc1d41-85f2-4626-8408-479a083a4cd1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:36.934753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d5bc1d41-85f2-4626-8408-479a083a4cd1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:36.941282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d5bc1d41-85f2-4626-8408-479a083a4cd1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:36.941880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d5bc1d41-85f2-4626-8408-479a083a4cd1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:36.942833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d5bc1d41-85f2-4626-8408-479a083a4cd1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:36.943356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d5bc1d41-85f2-4626-8408-479a083a4cd1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:37.087347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d5bc1d41-85f2-4626-8408-479a083a4cd1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:37.095875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d5bc1d41-85f2-4626-8408-479a083a4cd1 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1555 microversion: 2.1 time: 0.166939 Jun 02 16:07:37.096726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 79/153] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:36 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:37.507451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-301b6f74-1d13-4b9b-96a4-bae1a2e0a419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:37.508054 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-301b6f74-1d13-4b9b-96a4-bae1a2e0a419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:37.515252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-301b6f74-1d13-4b9b-96a4-bae1a2e0a419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:37.517211 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-301b6f74-1d13-4b9b-96a4-bae1a2e0a419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:37.517211 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-301b6f74-1d13-4b9b-96a4-bae1a2e0a419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:37.517211 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-301b6f74-1d13-4b9b-96a4-bae1a2e0a419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:37.752462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-301b6f74-1d13-4b9b-96a4-bae1a2e0a419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:37.764102 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-301b6f74-1d13-4b9b-96a4-bae1a2e0a419 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.260549 Jun 02 16:07:37.767317 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 75/154] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:37 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:38.116600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5a90764f-3b97-4ec8-9431-10abd39093d4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:38.117957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5a90764f-3b97-4ec8-9431-10abd39093d4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:38.132574 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-673ae2ed-b48b-4fe3-a152-288a33ebff80 req-8f88f48d-0a96-400b-96e8-d857a09b3da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dca03cf-a22a-4285-9da1-a8d857866775", "name": "network-vif-deleted", "tag": "24662bd8-e12f-432f-962d-8ccdff736040"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:07:38.140681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a90764f-3b97-4ec8-9431-10abd39093d4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:38.141128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a90764f-3b97-4ec8-9431-10abd39093d4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:38.141959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a90764f-3b97-4ec8-9431-10abd39093d4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:38.142424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a90764f-3b97-4ec8-9431-10abd39093d4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:38.147722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-673ae2ed-b48b-4fe3-a152-288a33ebff80 req-8f88f48d-0a96-400b-96e8-d857a09b3da8 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:38.148158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-673ae2ed-b48b-4fe3-a152-288a33ebff80 req-8f88f48d-0a96-400b-96e8-d857a09b3da8 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:38.174849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-673ae2ed-b48b-4fe3-a152-288a33ebff80 req-8f88f48d-0a96-400b-96e8-d857a09b3da8 service nova] Creating event network-vif-deleted:24662bd8-e12f-432f-962d-8ccdff736040 for instance 4dca03cf-a22a-4285-9da1-a8d857866775 on hv-cinder-79760 Jun 02 16:07:38.180992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-673ae2ed-b48b-4fe3-a152-288a33ebff80 req-8f88f48d-0a96-400b-96e8-d857a09b3da8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053234 Jun 02 16:07:38.183131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 76/155] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:07:38.247895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5a90764f-3b97-4ec8-9431-10abd39093d4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:38.258539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5a90764f-3b97-4ec8-9431-10abd39093d4 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1513 microversion: 2.1 time: 0.147604 Jun 02 16:07:38.259120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 80/156] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:38 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:07:38.785152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-50aa124f-9c3e-46ee-b7ca-621268488edc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:38.786134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-50aa124f-9c3e-46ee-b7ca-621268488edc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:38.797892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50aa124f-9c3e-46ee-b7ca-621268488edc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:38.802363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50aa124f-9c3e-46ee-b7ca-621268488edc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:38.803275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50aa124f-9c3e-46ee-b7ca-621268488edc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:38.807216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50aa124f-9c3e-46ee-b7ca-621268488edc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:38.994945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-50aa124f-9c3e-46ee-b7ca-621268488edc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:39.018886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-50aa124f-9c3e-46ee-b7ca-621268488edc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.237904 Jun 02 16:07:39.028100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 77/157] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:38 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:39.276179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:39.277036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:39.284583 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:39.284852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:39.285646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:39.286094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:39.323187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:39.323626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:39.324078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lazy-loading 'fault' on Instance uuid 4dca03cf-a22a-4285-9da1-a8d857866775 {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:07:39.367692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1400263107254337be69dc15e8d046d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e72d608f9b243739572bf4fab56bd13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:39.376387 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-569ababc-92a4-417e-9bdf-ae74ef1e2e08 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 200 len: 1351 microversion: 2.1 time: 0.104982 Jun 02 16:07:39.376948 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 81/158] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:39 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:40.036711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4f5001db-980d-46b0-b9fe-bfb4d3883938 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:40.038015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4f5001db-980d-46b0-b9fe-bfb4d3883938 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:40.048130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f5001db-980d-46b0-b9fe-bfb4d3883938 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:40.048841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f5001db-980d-46b0-b9fe-bfb4d3883938 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:40.050050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f5001db-980d-46b0-b9fe-bfb4d3883938 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:40.050847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f5001db-980d-46b0-b9fe-bfb4d3883938 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:40.208603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4f5001db-980d-46b0-b9fe-bfb4d3883938 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:40.220530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4f5001db-980d-46b0-b9fe-bfb4d3883938 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.188336 Jun 02 16:07:40.221832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 78/159] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:40 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:40.394059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:40.394699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:40.403811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:40.404264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:40.405187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:40.405629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:40.421485 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] HTTP exception thrown: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Request method failure captured: Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 HTTP/1.1 Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOAEltdyuwRzh-XI75N1w9ZysoUrd5LD26qeQUCTEsOaYzkCpmsnUcNCDy8tkXZG9KYkCouYbkmPBvzHGNU0LM7xz6963oDui7SpF-Qxn_tgS2Fc2L0byyaesT_bDqlS6APjaBAdxNqZxfnsUvuPfNnllUp3x46mEWMJNMqlYI0Vpqk Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 8e72d608f9b243739572bf4fab56bd13 Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:07:40.426129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8e72d608f9b243739572bf4fab56bd13"}]}] Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 8e72d608f9b243739572bf4fab56bd13 Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-DeleteServersTestJSON-143692180-project Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 1400263107254337be69dc15e8d046d4 Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-DeleteServersTestJSON-143692180-project Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.427816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '4dca03cf-a22a-4285-9da1-a8d857866775'} Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:07:40.428527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.429613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.430566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Returning 404 to user: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:07:40.430566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a98b9b41-52c7-4106-9ef8-ed5a5f0f999a tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 404 len: 111 microversion: 2.1 time: 0.037579 Jun 02 16:07:40.430566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 82/160] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:40 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:07:40.543542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:40.544705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:40.551092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:40.551606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:40.552371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:40.552801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:40.566609 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] HTTP exception thrown: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Request method failure captured: Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775/os-volume_attachments HTTP/1.1 Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOAEltdyuwRzh-XI75N1w9ZysoUrd5LD26qeQUCTEsOaYzkCpmsnUcNCDy8tkXZG9KYkCouYbkmPBvzHGNU0LM7xz6963oDui7SpF-Qxn_tgS2Fc2L0byyaesT_bDqlS6APjaBAdxNqZxfnsUvuPfNnllUp3x46mEWMJNMqlYI0Vpqk Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 8e72d608f9b243739572bf4fab56bd13 Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:07:40.570699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8e72d608f9b243739572bf4fab56bd13"}]}] Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 8e72d608f9b243739572bf4fab56bd13 Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-DeleteServersTestJSON-143692180-project Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 1400263107254337be69dc15e8d046d4 Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-DeleteServersTestJSON-143692180-project Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.571820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'server_id': '4dca03cf-a22a-4285-9da1-a8d857866775'} Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:07:40.573145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:40.574281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:40.575351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Returning 404 to user: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:07:40.575351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-36a70de9-6263-41d5-a22b-530e6ba9b0a7 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032835 Jun 02 16:07:40.575351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 79/161] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:07:40 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:07:41.239750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-77509a37-2e90-4bd6-954a-2ac5ca87d90c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:41.240571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-77509a37-2e90-4bd6-954a-2ac5ca87d90c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:41.250566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77509a37-2e90-4bd6-954a-2ac5ca87d90c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:41.252714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77509a37-2e90-4bd6-954a-2ac5ca87d90c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:41.253973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77509a37-2e90-4bd6-954a-2ac5ca87d90c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:41.254623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77509a37-2e90-4bd6-954a-2ac5ca87d90c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:41.413977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-77509a37-2e90-4bd6-954a-2ac5ca87d90c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:41.424053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-77509a37-2e90-4bd6-954a-2ac5ca87d90c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.189224 Jun 02 16:07:41.425813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 83/162] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:41 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:42.444035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b43f1424-d80b-41d4-a9ee-66bde8543886 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:42.444035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b43f1424-d80b-41d4-a9ee-66bde8543886 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:42.452537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b43f1424-d80b-41d4-a9ee-66bde8543886 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:42.452985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b43f1424-d80b-41d4-a9ee-66bde8543886 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:42.453770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b43f1424-d80b-41d4-a9ee-66bde8543886 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:42.454245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b43f1424-d80b-41d4-a9ee-66bde8543886 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:42.718237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b43f1424-d80b-41d4-a9ee-66bde8543886 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:42.728451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b43f1424-d80b-41d4-a9ee-66bde8543886 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.287753 Jun 02 16:07:42.730314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 80/163] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:42 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:43.745965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-23cf6df7-662b-4a43-9c19-6851c89b505d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:43.746628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-23cf6df7-662b-4a43-9c19-6851c89b505d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:43.752693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23cf6df7-662b-4a43-9c19-6851c89b505d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:43.753183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23cf6df7-662b-4a43-9c19-6851c89b505d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:43.753955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23cf6df7-662b-4a43-9c19-6851c89b505d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:43.754427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23cf6df7-662b-4a43-9c19-6851c89b505d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:43.894663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-23cf6df7-662b-4a43-9c19-6851c89b505d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:43.902709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-23cf6df7-662b-4a43-9c19-6851c89b505d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.160710 Jun 02 16:07:43.903269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 84/164] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:43 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:44.920970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d85837db-9eef-4023-9fab-51926c3a6c7e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:44.922423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d85837db-9eef-4023-9fab-51926c3a6c7e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:44.931119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d85837db-9eef-4023-9fab-51926c3a6c7e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:44.932596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d85837db-9eef-4023-9fab-51926c3a6c7e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:44.933902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d85837db-9eef-4023-9fab-51926c3a6c7e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:44.934435 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d85837db-9eef-4023-9fab-51926c3a6c7e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:45.090248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d85837db-9eef-4023-9fab-51926c3a6c7e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:45.091408 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:45.098662 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d85837db-9eef-4023-9fab-51926c3a6c7e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.183058 Jun 02 16:07:45.099562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 81/165] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:44 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:46.116006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7142cbaf-6ed6-468d-b0fc-5d4d756af16d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:46.116630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7142cbaf-6ed6-468d-b0fc-5d4d756af16d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:46.133432 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7142cbaf-6ed6-468d-b0fc-5d4d756af16d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:46.134332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7142cbaf-6ed6-468d-b0fc-5d4d756af16d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:46.136709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7142cbaf-6ed6-468d-b0fc-5d4d756af16d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:46.137547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7142cbaf-6ed6-468d-b0fc-5d4d756af16d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:46.300172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7142cbaf-6ed6-468d-b0fc-5d4d756af16d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:46.308287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7142cbaf-6ed6-468d-b0fc-5d4d756af16d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.196535 Jun 02 16:07:46.308863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 85/166] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:46 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:46.556680 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:46.557340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:46.566299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:46.566742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:46.567518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:46.568026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:46.582678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] HTTP exception thrown: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Request method failure captured: Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 HTTP/1.1 Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOAEltdyuwRzh-XI75N1w9ZysoUrd5LD26qeQUCTEsOaYzkCpmsnUcNCDy8tkXZG9KYkCouYbkmPBvzHGNU0LM7xz6963oDui7SpF-Qxn_tgS2Fc2L0byyaesT_bDqlS6APjaBAdxNqZxfnsUvuPfNnllUp3x46mEWMJNMqlYI0Vpqk Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 8e72d608f9b243739572bf4fab56bd13 Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:07:46.585266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8e72d608f9b243739572bf4fab56bd13"}]}] Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 8e72d608f9b243739572bf4fab56bd13 Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-DeleteServersTestJSON-143692180-project Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 1400263107254337be69dc15e8d046d4 Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-DeleteServersTestJSON-143692180-project Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.589453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '4dca03cf-a22a-4285-9da1-a8d857866775'} Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:07:46.590266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.591448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.592701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Returning 404 to user: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:07:46.592701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c46ed4a0-b2bc-4b70-84fd-4ee7788e806d tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 404 len: 111 microversion: 2.1 time: 0.034759 Jun 02 16:07:46.592701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 82/167] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:07:46 2022] DELETE /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 16:07:46.603550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:46.604546 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] [instance: 4dca03cf-a22a-4285-9da1-a8d857866775] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:46.612859 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:46.613380 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:46.614737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:46.615200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:46.638235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] HTTP exception thrown: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Request method failure captured: Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 HTTP/1.1 Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOAEltdyuwRzh-XI75N1w9ZysoUrd5LD26qeQUCTEsOaYzkCpmsnUcNCDy8tkXZG9KYkCouYbkmPBvzHGNU0LM7xz6963oDui7SpF-Qxn_tgS2Fc2L0byyaesT_bDqlS6APjaBAdxNqZxfnsUvuPfNnllUp3x46mEWMJNMqlYI0Vpqk Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 8e72d608f9b243739572bf4fab56bd13 Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:07:46.640212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8e72d608f9b243739572bf4fab56bd13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8e72d608f9b243739572bf4fab56bd13"}]}] Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 8e72d608f9b243739572bf4fab56bd13 Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-DeleteServersTestJSON-143692180 Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-DeleteServersTestJSON-143692180-project Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 1400263107254337be69dc15e8d046d4 Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-DeleteServersTestJSON-143692180-project Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.641668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '4dca03cf-a22a-4285-9da1-a8d857866775'} Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:07:46.642775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. Jun 02 16:07:46.644227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:07:46.657752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] Returning 404 to user: Instance 4dca03cf-a22a-4285-9da1-a8d857866775 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:07:46.663285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9b9eaa96-4291-4fa1-af5c-19d55969bc62 tempest-DeleteServersTestJSON-143692180 tempest-DeleteServersTestJSON-143692180-project] 10.222.0.59 "GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775" status: 404 len: 111 microversion: 2.1 time: 0.071234 Jun 02 16:07:46.664407 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 86/168] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:46 2022] GET /compute/v2.1/servers/4dca03cf-a22a-4285-9da1-a8d857866775 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:07:47.326854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f707f156-f535-4ddf-8393-4de4aafedf84 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:47.327659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f707f156-f535-4ddf-8393-4de4aafedf84 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:47.341492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f707f156-f535-4ddf-8393-4de4aafedf84 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:47.344504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f707f156-f535-4ddf-8393-4de4aafedf84 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:47.345920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f707f156-f535-4ddf-8393-4de4aafedf84 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:47.347926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f707f156-f535-4ddf-8393-4de4aafedf84 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:47.764435 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f707f156-f535-4ddf-8393-4de4aafedf84 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:47.786708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f707f156-f535-4ddf-8393-4de4aafedf84 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.453822 Jun 02 16:07:47.786708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 83/169] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:47 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:48.794700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-121fe15a-09c1-4c73-b8f2-0cd1005d34ea tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:48.795456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-121fe15a-09c1-4c73-b8f2-0cd1005d34ea tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:48.804999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-121fe15a-09c1-4c73-b8f2-0cd1005d34ea tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:48.804999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-121fe15a-09c1-4c73-b8f2-0cd1005d34ea tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:48.807314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-121fe15a-09c1-4c73-b8f2-0cd1005d34ea tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:48.807314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-121fe15a-09c1-4c73-b8f2-0cd1005d34ea tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:48.813465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:49.029578 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-121fe15a-09c1-4c73-b8f2-0cd1005d34ea tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:49.039371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-121fe15a-09c1-4c73-b8f2-0cd1005d34ea tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.249888 Jun 02 16:07:49.050633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 87/170] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:48 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:50.060305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-93f8978e-d661-4b59-bee5-499e9b12b950 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:50.061484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-93f8978e-d661-4b59-bee5-499e9b12b950 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:50.076372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93f8978e-d661-4b59-bee5-499e9b12b950 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:50.076820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93f8978e-d661-4b59-bee5-499e9b12b950 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:50.080375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93f8978e-d661-4b59-bee5-499e9b12b950 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:50.089295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93f8978e-d661-4b59-bee5-499e9b12b950 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:50.364436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-93f8978e-d661-4b59-bee5-499e9b12b950 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:50.372927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-93f8978e-d661-4b59-bee5-499e9b12b950 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.319084 Jun 02 16:07:50.374151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 84/171] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:50 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:51.391126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d83a4d38-7099-4160-9699-94f77c245b5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:51.395041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d83a4d38-7099-4160-9699-94f77c245b5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:51.414170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d83a4d38-7099-4160-9699-94f77c245b5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:51.414626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d83a4d38-7099-4160-9699-94f77c245b5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:51.415413 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d83a4d38-7099-4160-9699-94f77c245b5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:51.416553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d83a4d38-7099-4160-9699-94f77c245b5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:51.762094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d83a4d38-7099-4160-9699-94f77c245b5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:51.770375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d83a4d38-7099-4160-9699-94f77c245b5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.384038 Jun 02 16:07:51.771219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 88/172] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:51 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:52.789889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-110232ef-7296-4ca7-999e-7778bdefba98 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:52.790747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-110232ef-7296-4ca7-999e-7778bdefba98 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:52.804277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-110232ef-7296-4ca7-999e-7778bdefba98 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:52.809450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-110232ef-7296-4ca7-999e-7778bdefba98 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:52.809450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-110232ef-7296-4ca7-999e-7778bdefba98 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:52.809450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-110232ef-7296-4ca7-999e-7778bdefba98 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:52.985718 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-110232ef-7296-4ca7-999e-7778bdefba98 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:52.996027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-110232ef-7296-4ca7-999e-7778bdefba98 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.211473 Jun 02 16:07:52.997129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 85/173] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:52 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:54.013412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-66ca062b-f85b-48d1-a681-dd44fd35ef00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:54.014544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-66ca062b-f85b-48d1-a681-dd44fd35ef00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:54.025675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66ca062b-f85b-48d1-a681-dd44fd35ef00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:54.026363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66ca062b-f85b-48d1-a681-dd44fd35ef00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:54.027294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66ca062b-f85b-48d1-a681-dd44fd35ef00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:54.027864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66ca062b-f85b-48d1-a681-dd44fd35ef00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:54.440788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-66ca062b-f85b-48d1-a681-dd44fd35ef00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:54.456813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-66ca062b-f85b-48d1-a681-dd44fd35ef00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.445522 Jun 02 16:07:54.461938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 89/174] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:54 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:55.504341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-434fc47f-7cba-427c-8350-b0b01ea6defc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:55.505419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-434fc47f-7cba-427c-8350-b0b01ea6defc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:55.524985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-434fc47f-7cba-427c-8350-b0b01ea6defc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:55.525977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-434fc47f-7cba-427c-8350-b0b01ea6defc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:55.526995 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-434fc47f-7cba-427c-8350-b0b01ea6defc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:55.527589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-434fc47f-7cba-427c-8350-b0b01ea6defc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:55.695715 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-434fc47f-7cba-427c-8350-b0b01ea6defc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:55.703524 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-434fc47f-7cba-427c-8350-b0b01ea6defc tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.209521 Jun 02 16:07:55.705726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 86/175] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:55 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:56.721991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-868c0ff9-dfde-47ca-b345-cb88f5c53dd8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:56.723260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-868c0ff9-dfde-47ca-b345-cb88f5c53dd8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:56.731266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-868c0ff9-dfde-47ca-b345-cb88f5c53dd8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:56.735740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-868c0ff9-dfde-47ca-b345-cb88f5c53dd8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:56.736800 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-868c0ff9-dfde-47ca-b345-cb88f5c53dd8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:56.737545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-868c0ff9-dfde-47ca-b345-cb88f5c53dd8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:57.229255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-868c0ff9-dfde-47ca-b345-cb88f5c53dd8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:57.240794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-868c0ff9-dfde-47ca-b345-cb88f5c53dd8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.521986 Jun 02 16:07:57.244999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 90/176] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:56 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:58.259391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-69e957ce-a007-4165-a051-da5861cace72 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:58.261126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-69e957ce-a007-4165-a051-da5861cace72 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:58.276648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-69e957ce-a007-4165-a051-da5861cace72 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:58.277393 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-69e957ce-a007-4165-a051-da5861cace72 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:58.278416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-69e957ce-a007-4165-a051-da5861cace72 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:58.279011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-69e957ce-a007-4165-a051-da5861cace72 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:58.707788 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-69e957ce-a007-4165-a051-da5861cace72 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:07:58.739712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-69e957ce-a007-4165-a051-da5861cace72 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.482049 Jun 02 16:07:58.744938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 87/177] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:58 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:07:59.759175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-03826e39-f689-499b-9d79-2451a06b9f8a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:07:59.761204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-03826e39-f689-499b-9d79-2451a06b9f8a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:07:59.785537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03826e39-f689-499b-9d79-2451a06b9f8a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:59.786397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03826e39-f689-499b-9d79-2451a06b9f8a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:07:59.789760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03826e39-f689-499b-9d79-2451a06b9f8a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:07:59.790262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03826e39-f689-499b-9d79-2451a06b9f8a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:00.116055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-03826e39-f689-499b-9d79-2451a06b9f8a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:00.126198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-03826e39-f689-499b-9d79-2451a06b9f8a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.371809 Jun 02 16:08:00.127317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 91/178] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:07:59 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:00.337300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2430965f-3c0a-43f8-9d12-2d8b163e3096 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'create', calling method: .version_select at 0x7f2d5c4be040>, body: {"keypair": {"name": "tempest-keypair-283040103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZFTGP7i4Ut3ucE3deJB4YqBSJLV7gMUuGCrQwSU5791uknsIWOjZBeNEaX8wIpenGcDfwqVUNqwO7aDAzDB7vw41FQBmW4ma2Ki7t7Q1P1lY/Feqy02WmPp6+GIgvtlA=="}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:08:00.348275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:00.370839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-2430965f-3c0a-43f8-9d12-2d8b163e3096 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Getting quotas for project 470abf75f36f4a84b9382efc2aa2fc1c. Resources: {'key_pairs'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:08:00.375452 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-2430965f-3c0a-43f8-9d12-2d8b163e3096 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Getting quotas for user 95108cdd8e134be3823d5024f7037b3e and project 470abf75f36f4a84b9382efc2aa2fc1c. Resources: {'key_pairs'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:08:00.544914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2430965f-3c0a-43f8-9d12-2d8b163e3096 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.445487 Jun 02 16:08:00.545778 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 88/179] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Jun 2 16:08:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 447 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 16:08:01.145761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5caa0e1a-1d19-4b94-a8f3-19d303d19d5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:01.151017 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5caa0e1a-1d19-4b94-a8f3-19d303d19d5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:01.161064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5caa0e1a-1d19-4b94-a8f3-19d303d19d5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:01.161439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5caa0e1a-1d19-4b94-a8f3-19d303d19d5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:01.162246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5caa0e1a-1d19-4b94-a8f3-19d303d19d5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:01.162682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5caa0e1a-1d19-4b94-a8f3-19d303d19d5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:01.440046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5caa0e1a-1d19-4b94-a8f3-19d303d19d5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:01.452953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5caa0e1a-1d19-4b94-a8f3-19d303d19d5c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.312054 Jun 02 16:08:01.455173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 92/180] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:01 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:02.472463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-493f6611-a10b-4d6b-99ab-20c5bb9ac026 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:02.473076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-493f6611-a10b-4d6b-99ab-20c5bb9ac026 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:02.481289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-493f6611-a10b-4d6b-99ab-20c5bb9ac026 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:02.481758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-493f6611-a10b-4d6b-99ab-20c5bb9ac026 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:02.482573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-493f6611-a10b-4d6b-99ab-20c5bb9ac026 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:02.483010 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-493f6611-a10b-4d6b-99ab-20c5bb9ac026 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:02.638416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-493f6611-a10b-4d6b-99ab-20c5bb9ac026 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:02.644291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-493f6611-a10b-4d6b-99ab-20c5bb9ac026 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.175591 Jun 02 16:08:02.645192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 89/181] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:02 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:03.666188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-01c79b45-9c00-4233-8da1-d21768a2dbdd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:03.671188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-01c79b45-9c00-4233-8da1-d21768a2dbdd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:03.673174 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=40 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:03.688511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01c79b45-9c00-4233-8da1-d21768a2dbdd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:03.693226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01c79b45-9c00-4233-8da1-d21768a2dbdd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:03.693226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01c79b45-9c00-4233-8da1-d21768a2dbdd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:03.693226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01c79b45-9c00-4233-8da1-d21768a2dbdd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:03.923077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-01c79b45-9c00-4233-8da1-d21768a2dbdd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:03.935344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-01c79b45-9c00-4233-8da1-d21768a2dbdd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.276722 Jun 02 16:08:03.944668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 93/182] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:03 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:04.740070 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-44231654", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b93d0ec-397d-4791-9a03-a5b57663e875"}], "security_groups": [{"name": "tempest-securitygroup--98988782"}], "key_name": "tempest-keypair-283040103", "user_data": "}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:08:04.953923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2e0942dc-fa49-42e8-979a-f4b4574665bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:04.955455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2e0942dc-fa49-42e8-979a-f4b4574665bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:04.967122 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e0942dc-fa49-42e8-979a-f4b4574665bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:04.971493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e0942dc-fa49-42e8-979a-f4b4574665bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:04.972568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e0942dc-fa49-42e8-979a-f4b4574665bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:04.973732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e0942dc-fa49-42e8-979a-f4b4574665bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:05.221498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2e0942dc-fa49-42e8-979a-f4b4574665bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:05.244157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2e0942dc-fa49-42e8-979a-f4b4574665bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1521 microversion: 2.1 time: 0.295108 Jun 02 16:08:05.247300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 94/183] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:04 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:06.268694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8c07b23b-2efc-4657-a0aa-1a93ab4eac9b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:06.271574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8c07b23b-2efc-4657-a0aa-1a93ab4eac9b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:06.278254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c07b23b-2efc-4657-a0aa-1a93ab4eac9b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:06.279019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c07b23b-2efc-4657-a0aa-1a93ab4eac9b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:06.280054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c07b23b-2efc-4657-a0aa-1a93ab4eac9b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:06.280741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c07b23b-2efc-4657-a0aa-1a93ab4eac9b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:06.495500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8c07b23b-2efc-4657-a0aa-1a93ab4eac9b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:06.509228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8c07b23b-2efc-4657-a0aa-1a93ab4eac9b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1501 microversion: 2.1 time: 0.245157 Jun 02 16:08:06.510901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 95/184] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:06 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1501 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:06.528879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9d21c023-65e7-4819-b049-6f32ca8cc5bd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:06.541705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9d21c023-65e7-4819-b049-6f32ca8cc5bd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:06.541705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d21c023-65e7-4819-b049-6f32ca8cc5bd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:06.541705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d21c023-65e7-4819-b049-6f32ca8cc5bd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:06.541705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d21c023-65e7-4819-b049-6f32ca8cc5bd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:06.542065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d21c023-65e7-4819-b049-6f32ca8cc5bd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:06.712991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9d21c023-65e7-4819-b049-6f32ca8cc5bd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:06.731601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9d21c023-65e7-4819-b049-6f32ca8cc5bd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1517 microversion: 2.1 time: 0.197320 Jun 02 16:08:06.731601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 96/185] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:06 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1517 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:07.035599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] validate_networks() for [('0b93d0ec-397d-4791-9a03-a5b57663e875', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:08:07.515838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:08:07.516366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:08:07.517004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:08:07.517635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:08:07.518290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:08:07.534016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:07.535415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:07.535520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:07.536019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:07.557880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Getting quotas for project 470abf75f36f4a84b9382efc2aa2fc1c. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:08:07.562592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Getting quotas for user 95108cdd8e134be3823d5024f7037b3e and project 470abf75f36f4a84b9382efc2aa2fc1c. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:08:07.580948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:08:07.586925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:08:07.842912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-164bbac3-1747-43b4-ac03-a07413299612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 3.106992 Jun 02 16:08:07.843604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 90/186] 10.222.0.59 () {62 vars in 1187 bytes} [Thu Jun 2 16:08:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 3108 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 16:08:07.853837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9688c5f2-8f85-4703-926e-d4e6da95cbc8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:07.854498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9688c5f2-8f85-4703-926e-d4e6da95cbc8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:07.915352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9688c5f2-8f85-4703-926e-d4e6da95cbc8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:07.923740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9688c5f2-8f85-4703-926e-d4e6da95cbc8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:07.926506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9688c5f2-8f85-4703-926e-d4e6da95cbc8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:07.928572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9688c5f2-8f85-4703-926e-d4e6da95cbc8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1279 microversion: 2.20 time: 0.078218 Jun 02 16:08:07.929343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 97/187] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:07 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1279 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:08.950235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cae332bb-d23d-451e-b614-5ef1e6d28fbb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:08.951571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cae332bb-d23d-451e-b614-5ef1e6d28fbb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:09.032088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cae332bb-d23d-451e-b614-5ef1e6d28fbb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:09.046304 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cae332bb-d23d-451e-b614-5ef1e6d28fbb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:09.047865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cae332bb-d23d-451e-b614-5ef1e6d28fbb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:09.049067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cae332bb-d23d-451e-b614-5ef1e6d28fbb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1279 microversion: 2.20 time: 0.103576 Jun 02 16:08:09.049976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 91/188] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:08 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:10.072567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:10.072567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:10.080869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:10.081312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:10.082098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:10.082536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:10.196526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:10.205777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:10.207552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:10.208973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-662737f6-be9f-4abd-8105-d9eb70bfc774 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1283 microversion: 2.20 time: 0.143260 Jun 02 16:08:10.220275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 98/189] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:10 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1283 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:11.229411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:11.230730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:11.238334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:11.239092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:11.240096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:11.240683 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:11.310386 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:11.323601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:11.325313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:11.326658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1b933e33-bbd1-430f-8798-92334c7005ac tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1283 microversion: 2.20 time: 0.101998 Jun 02 16:08:11.327731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 92/190] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:11 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:12.280222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-84eeae02-f9fc-458b-894b-5f8014a07a61 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Action: 'create', calling method: .version_select at 0x7f2d5c5bb1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1798691851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHia0UK7I1tMonrXtsrIp0IalXJHCGyUZZ4T21FYaErQoTa+OyajoNxglGmATh/4YWPFGcQ6/ETrFEuA6ygWvVfqJRiuL83qR7klT8HA0NQPCt6iq3SAqftxGAhr3zGvg=="}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:08:12.308570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-84eeae02-f9fc-458b-894b-5f8014a07a61 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Getting quotas for project b9ae3e4e2fa943d497623a549e23f906. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:08:12.313067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-84eeae02-f9fc-458b-894b-5f8014a07a61 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Getting quotas for user 88d362d24ff54106b00d945599f2a61d and project b9ae3e4e2fa943d497623a549e23f906. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:08:12.344855 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:12.345471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:12.351853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:12.352362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:12.353260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:12.353827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:12.415299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-84eeae02-f9fc-458b-894b-5f8014a07a61 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.140052 Jun 02 16:08:12.418564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 99/191] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 2 16:08:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:08:12.423923 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:12.432450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:12.434177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:12.435548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ea3f06fe-0930-4576-86e6-845817a60bad tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1275 microversion: 2.20 time: 0.094562 Jun 02 16:08:12.436285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 93/192] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:12 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:12.565286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-858043701", "imageRef": "b043c79e-b057-4b8b-bafd-aa31d3f05be8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1798691851", "networks": [{"uuid": "8bb82b32-b679-474d-aea9-4fb7c5864981"}]}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:08:12.624776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.network.neutron [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] validate_networks() for [('8bb82b32-b679-474d-aea9-4fb7c5864981', None, None, None, None, None)] {{(pid=118256) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:08:13.205720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Flavor limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:08:13.206263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Image limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:08:13.206891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Flavor pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:08:13.207378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Image pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:08:13.207930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:08:13.217648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:13.218298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:13.219282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:13.219734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:13.238710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Getting quotas for project b9ae3e4e2fa943d497623a549e23f906. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:08:13.243088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Getting quotas for user 88d362d24ff54106b00d945599f2a61d and project b9ae3e4e2fa943d497623a549e23f906. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:08:13.266792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Going to run 1 instances... {{(pid=118256) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:08:13.269183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b043c79e-b057-4b8b-bafd-aa31d3f05be8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:08:13.425638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c309293d-5c76-4491-b529-db6c73fd5bf0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864099 Jun 02 16:08:13.432325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 100/193] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:08:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:08:13.444084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-61bfd4d0-b08e-4fe8-a45e-b982eeff927d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:13.445845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-61bfd4d0-b08e-4fe8-a45e-b982eeff927d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:13.459005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:13.480074 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:13.507954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:13.508639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:13.512367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:13.513078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:13.607410 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-61bfd4d0-b08e-4fe8-a45e-b982eeff927d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:13.619405 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-61bfd4d0-b08e-4fe8-a45e-b982eeff927d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1258 microversion: 2.1 time: 0.182462 Jun 02 16:08:13.620597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 94/194] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:13 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:13.642633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:13.661761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:13.664201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:13.666849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8b9d910f-f2ef-4bbc-8039-fa60268fb202 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1349 microversion: 2.20 time: 0.210593 Jun 02 16:08:13.667686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 101/195] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:13 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1349 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:13.695456 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-177c4e53-360b-4381-a98d-ecea4a960736 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:08:13.697756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-177c4e53-360b-4381-a98d-ecea4a960736 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:13.705690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-177c4e53-360b-4381-a98d-ecea4a960736 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:13.706433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-177c4e53-360b-4381-a98d-ecea4a960736 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:13.707602 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-177c4e53-360b-4381-a98d-ecea4a960736 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:13.708425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-177c4e53-360b-4381-a98d-ecea4a960736 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:13.740933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-177c4e53-360b-4381-a98d-ecea4a960736 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lazy-loading 'flavor' on Instance uuid fc302fd8-397a-45ed-9316-d78c9f5b324a {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:08:14.349368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-177c4e53-360b-4381-a98d-ecea4a960736 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a/action" status: 200 len: 32 microversion: 2.1 time: 0.659505 Jun 02 16:08:14.350100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 95/196] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:08:13 2022] POST /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a/action => generated 32 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 16:08:14.359631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-78b7758d-d00a-45b8-80d2-f421fa9b89ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:14.360322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-78b7758d-d00a-45b8-80d2-f421fa9b89ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:14.367588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78b7758d-d00a-45b8-80d2-f421fa9b89ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:14.368397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78b7758d-d00a-45b8-80d2-f421fa9b89ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:14.369923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78b7758d-d00a-45b8-80d2-f421fa9b89ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:14.370640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78b7758d-d00a-45b8-80d2-f421fa9b89ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:14.527865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-78b7758d-d00a-45b8-80d2-f421fa9b89ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:14.536095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-78b7758d-d00a-45b8-80d2-f421fa9b89ad tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.180315 Jun 02 16:08:14.537135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 102/197] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:14 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:14.640953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-734c76a2-6ec0-44ce-81c1-26a49bcdc657 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:14.641819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-734c76a2-6ec0-44ce-81c1-26a49bcdc657 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:14.687034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:14.687676 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:14.695036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:14.695497 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:14.696650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:14.697706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:14.776318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-734c76a2-6ec0-44ce-81c1-26a49bcdc657 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:14.783939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-734c76a2-6ec0-44ce-81c1-26a49bcdc657 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1258 microversion: 2.1 time: 0.150259 Jun 02 16:08:14.785959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 96/198] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:14 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:14.871937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:14.886735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:14.888957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:14.890202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6a372e4a-fe4f-4d7d-9556-e1193387387b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.206933 Jun 02 16:08:14.891434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 103/199] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:14 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:08:15.554678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f38d2f7a-c200-44ba-a547-3628ed44aaab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:15.555492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f38d2f7a-c200-44ba-a547-3628ed44aaab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:15.563270 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f38d2f7a-c200-44ba-a547-3628ed44aaab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:15.563733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f38d2f7a-c200-44ba-a547-3628ed44aaab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:15.564509 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f38d2f7a-c200-44ba-a547-3628ed44aaab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:15.564948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f38d2f7a-c200-44ba-a547-3628ed44aaab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:15.724349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-10d0f924-e119-42d4-8b91-edd24709c6de req-fd498d7b-3d59-4b7c-9f8d-994621a141a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bf99ae-5d36-4add-b49f-746e933e19cc", "tag": "95689152-b643-4d84-9f69-18b1c5d87d13"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:08:15.736256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-10d0f924-e119-42d4-8b91-edd24709c6de req-fd498d7b-3d59-4b7c-9f8d-994621a141a1 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:15.737382 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-10d0f924-e119-42d4-8b91-edd24709c6de req-fd498d7b-3d59-4b7c-9f8d-994621a141a1 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:15.749605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-10d0f924-e119-42d4-8b91-edd24709c6de req-fd498d7b-3d59-4b7c-9f8d-994621a141a1 service nova] Creating event network-changed:95689152-b643-4d84-9f69-18b1c5d87d13 for instance f8bf99ae-5d36-4add-b49f-746e933e19cc on hv-cinder-79760 Jun 02 16:08:15.755477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-10d0f924-e119-42d4-8b91-edd24709c6de req-fd498d7b-3d59-4b7c-9f8d-994621a141a1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034643 Jun 02 16:08:15.758251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 104/200] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:08:15.799354 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f38d2f7a-c200-44ba-a547-3628ed44aaab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:15.803090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bcf9cb15-5c38-4875-99ec-c7cccf3eaee3 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:15.803712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bcf9cb15-5c38-4875-99ec-c7cccf3eaee3 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:15.809464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f38d2f7a-c200-44ba-a547-3628ed44aaab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.258993 Jun 02 16:08:15.811672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcf9cb15-5c38-4875-99ec-c7cccf3eaee3 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:15.812281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcf9cb15-5c38-4875-99ec-c7cccf3eaee3 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:15.813208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcf9cb15-5c38-4875-99ec-c7cccf3eaee3 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:15.813780 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcf9cb15-5c38-4875-99ec-c7cccf3eaee3 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:15.819129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 97/201] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:15 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:15.883579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bcf9cb15-5c38-4875-99ec-c7cccf3eaee3 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:15.892947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bcf9cb15-5c38-4875-99ec-c7cccf3eaee3 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1262 microversion: 2.1 time: 0.094395 Jun 02 16:08:15.893686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 105/202] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:15 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:15.914724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:15.915894 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:15.922243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:15.922700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:15.923471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:15.924075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:16.155550 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:16.164235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:16.165769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:16.174790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4ab31b4f-9fad-4a58-a8c3-70df378bf8bc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.263537 Jun 02 16:08:16.175429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 98/203] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:15 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:16.826646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8861baa8-522d-4cf9-befa-118f1abf4c3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:16.827401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8861baa8-522d-4cf9-befa-118f1abf4c3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:16.833434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8861baa8-522d-4cf9-befa-118f1abf4c3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:16.834027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8861baa8-522d-4cf9-befa-118f1abf4c3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:16.834905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8861baa8-522d-4cf9-befa-118f1abf4c3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:16.835341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8861baa8-522d-4cf9-befa-118f1abf4c3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:16.916174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e13e9073-42f8-4162-bbe6-1f0f7cf6894a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:16.916944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e13e9073-42f8-4162-bbe6-1f0f7cf6894a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:16.925037 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e13e9073-42f8-4162-bbe6-1f0f7cf6894a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:16.931978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e13e9073-42f8-4162-bbe6-1f0f7cf6894a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:16.934060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e13e9073-42f8-4162-bbe6-1f0f7cf6894a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:16.934548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e13e9073-42f8-4162-bbe6-1f0f7cf6894a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:16.998388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8861baa8-522d-4cf9-befa-118f1abf4c3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:17.005829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e13e9073-42f8-4162-bbe6-1f0f7cf6894a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:17.007103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8861baa8-522d-4cf9-befa-118f1abf4c3d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.184194 Jun 02 16:08:17.007801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 106/204] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:16 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:17.014886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e13e9073-42f8-4162-bbe6-1f0f7cf6894a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1310 microversion: 2.1 time: 0.107282 Jun 02 16:08:17.015449 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 99/205] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:16 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:17.194326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:17.194994 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:17.202798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:17.203267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:17.204032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:17.204466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:17.207144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:17.335552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:17.344161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:17.345839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:17.346976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-19fda71b-b391-4fee-84e7-dfe9acdbfac9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.157465 Jun 02 16:08:17.347545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 107/206] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:17 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:18.024505 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3377973d-b944-4b13-982a-73967245eb38 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:18.025202 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3377973d-b944-4b13-982a-73967245eb38 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:18.027215 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:18.032538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b1d4f6fd-e142-44eb-9dca-f5ef204c011f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:18.033028 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3377973d-b944-4b13-982a-73967245eb38 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:18.033554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b1d4f6fd-e142-44eb-9dca-f5ef204c011f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:18.033634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3377973d-b944-4b13-982a-73967245eb38 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:18.034013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3377973d-b944-4b13-982a-73967245eb38 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:18.034439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3377973d-b944-4b13-982a-73967245eb38 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:18.039996 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1d4f6fd-e142-44eb-9dca-f5ef204c011f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:18.040976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1d4f6fd-e142-44eb-9dca-f5ef204c011f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:18.041746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1d4f6fd-e142-44eb-9dca-f5ef204c011f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:18.042204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1d4f6fd-e142-44eb-9dca-f5ef204c011f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:18.103371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b1d4f6fd-e142-44eb-9dca-f5ef204c011f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:18.111195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b1d4f6fd-e142-44eb-9dca-f5ef204c011f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1318 microversion: 2.1 time: 0.082940 Jun 02 16:08:18.112272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 108/207] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:18 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1318 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:18.176091 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3377973d-b944-4b13-982a-73967245eb38 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:18.185060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3377973d-b944-4b13-982a-73967245eb38 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.164290 Jun 02 16:08:18.185732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 100/208] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:18 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:18.364731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:18.365288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:18.372659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:18.373107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:18.373877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:18.374353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:18.509730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:18.517685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:18.519203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:18.520296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9f3eb1b6-ddae-4b27-84e1-1fddee5a0e31 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.159540 Jun 02 16:08:18.523530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 109/209] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:18 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:19.129269 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-51e4afc8-dc20-4aea-b9ad-4af10ad67f7f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:19.129882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-51e4afc8-dc20-4aea-b9ad-4af10ad67f7f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:19.137128 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-51e4afc8-dc20-4aea-b9ad-4af10ad67f7f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:19.137572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-51e4afc8-dc20-4aea-b9ad-4af10ad67f7f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:19.138349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-51e4afc8-dc20-4aea-b9ad-4af10ad67f7f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:19.138783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-51e4afc8-dc20-4aea-b9ad-4af10ad67f7f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:19.201884 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-51e4afc8-dc20-4aea-b9ad-4af10ad67f7f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:19.202939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c066ffe0-363f-4cbb-b0f9-01cb5771abac tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:19.203557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c066ffe0-363f-4cbb-b0f9-01cb5771abac tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:19.204086 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:19.209667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c066ffe0-363f-4cbb-b0f9-01cb5771abac tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:19.214735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-51e4afc8-dc20-4aea-b9ad-4af10ad67f7f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1318 microversion: 2.1 time: 0.084696 Jun 02 16:08:19.214876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c066ffe0-363f-4cbb-b0f9-01cb5771abac tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:19.214975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 101/210] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:19 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1318 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:19.215060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c066ffe0-363f-4cbb-b0f9-01cb5771abac tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:19.215060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c066ffe0-363f-4cbb-b0f9-01cb5771abac tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:19.340908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c066ffe0-363f-4cbb-b0f9-01cb5771abac tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:19.348295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c066ffe0-363f-4cbb-b0f9-01cb5771abac tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.149284 Jun 02 16:08:19.348858 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 110/211] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:19 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:19.539351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:19.539949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:19.547059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:19.547501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:19.548298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:19.548721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:19.684203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:19.689658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:19.691212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:19.692319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e697e1c4-09e2-4253-bc7f-08458c2471e7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.157258 Jun 02 16:08:19.692857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 102/212] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:19 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:20.226716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4bf151f2-4b2e-484c-ad1f-8c31b2861481 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:20.227322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4bf151f2-4b2e-484c-ad1f-8c31b2861481 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:20.235001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4bf151f2-4b2e-484c-ad1f-8c31b2861481 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:20.235446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4bf151f2-4b2e-484c-ad1f-8c31b2861481 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:20.236207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4bf151f2-4b2e-484c-ad1f-8c31b2861481 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:20.236638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4bf151f2-4b2e-484c-ad1f-8c31b2861481 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:20.300711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4bf151f2-4b2e-484c-ad1f-8c31b2861481 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:20.309144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4bf151f2-4b2e-484c-ad1f-8c31b2861481 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1318 microversion: 2.1 time: 0.086299 Jun 02 16:08:20.309709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 111/213] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:20 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1318 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:20.365930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-498618f4-71eb-4a96-88b9-b37a360f6486 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:20.366588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-498618f4-71eb-4a96-88b9-b37a360f6486 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:20.374158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-498618f4-71eb-4a96-88b9-b37a360f6486 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:20.374615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-498618f4-71eb-4a96-88b9-b37a360f6486 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:20.375380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-498618f4-71eb-4a96-88b9-b37a360f6486 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:20.375821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-498618f4-71eb-4a96-88b9-b37a360f6486 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:20.502492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-498618f4-71eb-4a96-88b9-b37a360f6486 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:20.510257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-498618f4-71eb-4a96-88b9-b37a360f6486 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.148798 Jun 02 16:08:20.510833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 103/214] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:20 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:20.710531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:20.711799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:20.723332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:20.723861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:20.724713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:20.725252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:20.856341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:20.864234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:20.865728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:20.866845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0530acd7-127d-4f0f-940e-e4a9cc27ede9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.161268 Jun 02 16:08:20.867399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 112/215] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:20 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:21.326435 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fc5cfd5b-79e7-4397-b035-03631c5345c1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:21.327045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fc5cfd5b-79e7-4397-b035-03631c5345c1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:21.333029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc5cfd5b-79e7-4397-b035-03631c5345c1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:21.333474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc5cfd5b-79e7-4397-b035-03631c5345c1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:21.334261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc5cfd5b-79e7-4397-b035-03631c5345c1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:21.334698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc5cfd5b-79e7-4397-b035-03631c5345c1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:21.396785 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fc5cfd5b-79e7-4397-b035-03631c5345c1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:21.404170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fc5cfd5b-79e7-4397-b035-03631c5345c1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1318 microversion: 2.1 time: 0.081579 Jun 02 16:08:21.404739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 104/216] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:21 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1318 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:21.528277 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b60b46ce-9d2b-4350-a2c9-110608c19556 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:21.528893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b60b46ce-9d2b-4350-a2c9-110608c19556 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:21.535007 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b60b46ce-9d2b-4350-a2c9-110608c19556 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:21.535452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b60b46ce-9d2b-4350-a2c9-110608c19556 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:21.536212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b60b46ce-9d2b-4350-a2c9-110608c19556 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:21.536650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b60b46ce-9d2b-4350-a2c9-110608c19556 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:21.664099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b60b46ce-9d2b-4350-a2c9-110608c19556 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:21.671977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b60b46ce-9d2b-4350-a2c9-110608c19556 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.148517 Jun 02 16:08:21.672540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 113/217] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:21 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:21.885425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:21.886025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:21.892065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:21.892502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:21.893251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:21.893692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:22.020258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:22.028182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:22.029685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:22.030812 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-224edf8f-a910-4158-87ee-7ebfe3a46794 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.149737 Jun 02 16:08:22.031373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 105/218] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:21 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:22.421340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-40130227-08a8-462b-8c00-eec7adeb25ff tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:22.421948 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-40130227-08a8-462b-8c00-eec7adeb25ff tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:22.428033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40130227-08a8-462b-8c00-eec7adeb25ff tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:22.428469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40130227-08a8-462b-8c00-eec7adeb25ff tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:22.429216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40130227-08a8-462b-8c00-eec7adeb25ff tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:22.429637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40130227-08a8-462b-8c00-eec7adeb25ff tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:22.489251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-40130227-08a8-462b-8c00-eec7adeb25ff tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:22.496888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-40130227-08a8-462b-8c00-eec7adeb25ff tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1318 microversion: 2.1 time: 0.079410 Jun 02 16:08:22.497450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 114/219] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:22 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1318 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:22.689624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f756decd-04c2-4d70-bc22-fb57c507f7e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:22.690227 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f756decd-04c2-4d70-bc22-fb57c507f7e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:22.696806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f756decd-04c2-4d70-bc22-fb57c507f7e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:22.697297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f756decd-04c2-4d70-bc22-fb57c507f7e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:22.698726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f756decd-04c2-4d70-bc22-fb57c507f7e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:22.699165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f756decd-04c2-4d70-bc22-fb57c507f7e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:22.831076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f756decd-04c2-4d70-bc22-fb57c507f7e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:22.839655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f756decd-04c2-4d70-bc22-fb57c507f7e7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.153912 Jun 02 16:08:22.840221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 106/220] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:22 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:23.048581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:23.049191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:23.055407 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:23.055853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:23.056645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:23.057618 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:23.186263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:23.194234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:23.195719 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:23.196803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-be48005d-2873-4fb4-9f61-770b6291f2ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.152075 Jun 02 16:08:23.197352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 115/221] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:23 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:23.513944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a332f806-5780-4161-8a92-fb40a3c8d919 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:23.514737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a332f806-5780-4161-8a92-fb40a3c8d919 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:23.521003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a332f806-5780-4161-8a92-fb40a3c8d919 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:23.521558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a332f806-5780-4161-8a92-fb40a3c8d919 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:23.522449 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a332f806-5780-4161-8a92-fb40a3c8d919 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:23.522970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a332f806-5780-4161-8a92-fb40a3c8d919 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:23.590626 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a332f806-5780-4161-8a92-fb40a3c8d919 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:23.600354 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a332f806-5780-4161-8a92-fb40a3c8d919 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1318 microversion: 2.1 time: 0.090369 Jun 02 16:08:23.600933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 107/222] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:23 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1318 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:23.857191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d0b42712-7caf-49d4-ad66-afe20186c69d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:23.857850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d0b42712-7caf-49d4-ad66-afe20186c69d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:23.859876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:23.865313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=12 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:23.865536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0b42712-7caf-49d4-ad66-afe20186c69d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:23.865988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0b42712-7caf-49d4-ad66-afe20186c69d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:23.866811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0b42712-7caf-49d4-ad66-afe20186c69d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:23.867245 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0b42712-7caf-49d4-ad66-afe20186c69d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:24.003346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d0b42712-7caf-49d4-ad66-afe20186c69d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:24.011937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d0b42712-7caf-49d4-ad66-afe20186c69d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.159526 Jun 02 16:08:24.012504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 116/223] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:23 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:24.216326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:24.217053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:24.223648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:24.224101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:24.224883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:24.225302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:24.357907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:24.378909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:24.380430 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:24.381562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-177ed78c-e6b4-47d9-ac11-6d515574e95b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.170206 Jun 02 16:08:24.382135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 108/224] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:24 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:24.617133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-75696bea-1230-4702-892f-dcde40f59658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:24.617745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-75696bea-1230-4702-892f-dcde40f59658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:24.625217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75696bea-1230-4702-892f-dcde40f59658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:24.625605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75696bea-1230-4702-892f-dcde40f59658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:24.626397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75696bea-1230-4702-892f-dcde40f59658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:24.626831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75696bea-1230-4702-892f-dcde40f59658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:24.689650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-75696bea-1230-4702-892f-dcde40f59658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:24.697162 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-75696bea-1230-4702-892f-dcde40f59658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1328 microversion: 2.1 time: 0.084314 Jun 02 16:08:24.698415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 117/225] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:24 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1328 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:25.029456 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c14185d6-b61e-48f6-83ec-c79232eb08ab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:25.030399 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c14185d6-b61e-48f6-83ec-c79232eb08ab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:25.032621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=16 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:25.038341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c14185d6-b61e-48f6-83ec-c79232eb08ab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:25.038814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c14185d6-b61e-48f6-83ec-c79232eb08ab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:25.039581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c14185d6-b61e-48f6-83ec-c79232eb08ab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:25.040008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c14185d6-b61e-48f6-83ec-c79232eb08ab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:25.177820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c14185d6-b61e-48f6-83ec-c79232eb08ab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:25.186380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c14185d6-b61e-48f6-83ec-c79232eb08ab tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.161576 Jun 02 16:08:25.187053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 109/226] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:25 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:25.400285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:25.401496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:25.407849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:25.408300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:25.409106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:25.409601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:25.544110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:25.552151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:25.554731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:25.555923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-79f688d1-7290-4b75-a4c6-e9c975809479 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.159575 Jun 02 16:08:25.556485 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 118/227] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:25 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:08:25.718406 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c52c2689-114e-49fd-a53f-316a7a835249 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:25.718978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c52c2689-114e-49fd-a53f-316a7a835249 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:25.725943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c52c2689-114e-49fd-a53f-316a7a835249 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:25.726429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c52c2689-114e-49fd-a53f-316a7a835249 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:25.727202 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c52c2689-114e-49fd-a53f-316a7a835249 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:25.727637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c52c2689-114e-49fd-a53f-316a7a835249 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:25.793865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c52c2689-114e-49fd-a53f-316a7a835249 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:25.801574 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c52c2689-114e-49fd-a53f-316a7a835249 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1328 microversion: 2.1 time: 0.088989 Jun 02 16:08:25.802161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 110/228] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:25 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:26.210581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f7176cd4-28d4-46e5-8b5f-1fa2b7b24c70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:26.212806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f7176cd4-28d4-46e5-8b5f-1fa2b7b24c70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:26.219765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7176cd4-28d4-46e5-8b5f-1fa2b7b24c70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:26.220250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7176cd4-28d4-46e5-8b5f-1fa2b7b24c70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:26.221255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7176cd4-28d4-46e5-8b5f-1fa2b7b24c70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:26.221659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7176cd4-28d4-46e5-8b5f-1fa2b7b24c70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:26.353080 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f7176cd4-28d4-46e5-8b5f-1fa2b7b24c70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:26.362547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f7176cd4-28d4-46e5-8b5f-1fa2b7b24c70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.159118 Jun 02 16:08:26.363264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 119/229] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:26 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:26.574777 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:26.575434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:26.581375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:26.581820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:26.582625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:26.583085 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:26.714751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:26.722801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:26.724309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:26.725410 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a14b7aa2-1667-4465-8675-02a95257155d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.155257 Jun 02 16:08:26.725989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 111/230] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:26 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:08:26.819519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7ccc5258-55d9-4753-bebe-a10ccd15e178 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:26.820155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7ccc5258-55d9-4753-bebe-a10ccd15e178 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:26.826980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7ccc5258-55d9-4753-bebe-a10ccd15e178 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:26.827364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7ccc5258-55d9-4753-bebe-a10ccd15e178 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:26.828116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7ccc5258-55d9-4753-bebe-a10ccd15e178 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:26.828542 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7ccc5258-55d9-4753-bebe-a10ccd15e178 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:26.897436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7ccc5258-55d9-4753-bebe-a10ccd15e178 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:26.905957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7ccc5258-55d9-4753-bebe-a10ccd15e178 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1328 microversion: 2.1 time: 0.090263 Jun 02 16:08:26.906564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 120/231] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:26 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:27.379901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5cf89466-e5b1-42ab-b7cf-bb11534efa80 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:27.380448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5cf89466-e5b1-42ab-b7cf-bb11534efa80 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:27.387830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5cf89466-e5b1-42ab-b7cf-bb11534efa80 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:27.388278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5cf89466-e5b1-42ab-b7cf-bb11534efa80 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:27.389069 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5cf89466-e5b1-42ab-b7cf-bb11534efa80 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:27.389503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5cf89466-e5b1-42ab-b7cf-bb11534efa80 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:27.519640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5cf89466-e5b1-42ab-b7cf-bb11534efa80 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:27.527067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5cf89466-e5b1-42ab-b7cf-bb11534efa80 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.151133 Jun 02 16:08:27.527626 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 112/232] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:27 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:27.744376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:27.745751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:27.751667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:27.752129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:27.752891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:27.753319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:27.881106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:27.889072 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:27.890590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:27.891669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1e05eb91-52a7-406c-9212-cab8a1833888 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.151333 Jun 02 16:08:27.892224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 121/233] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:27 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:27.923299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-552e6a54-0413-4d43-b53e-7fcc6659e56f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:27.923917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-552e6a54-0413-4d43-b53e-7fcc6659e56f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:27.929873 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-552e6a54-0413-4d43-b53e-7fcc6659e56f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:27.930357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-552e6a54-0413-4d43-b53e-7fcc6659e56f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:27.931172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-552e6a54-0413-4d43-b53e-7fcc6659e56f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:27.931614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-552e6a54-0413-4d43-b53e-7fcc6659e56f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:28.007302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-552e6a54-0413-4d43-b53e-7fcc6659e56f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:28.007302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-552e6a54-0413-4d43-b53e-7fcc6659e56f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1328 microversion: 2.1 time: 0.087135 Jun 02 16:08:28.007302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 113/234] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:27 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1328 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:28.544123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c7fff84c-64a2-4cc8-a4b6-219e7f9669ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:28.544707 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c7fff84c-64a2-4cc8-a4b6-219e7f9669ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:28.550726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7fff84c-64a2-4cc8-a4b6-219e7f9669ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:28.551209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7fff84c-64a2-4cc8-a4b6-219e7f9669ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:28.551957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7fff84c-64a2-4cc8-a4b6-219e7f9669ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:28.552639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7fff84c-64a2-4cc8-a4b6-219e7f9669ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:28.703096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c7fff84c-64a2-4cc8-a4b6-219e7f9669ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:28.712841 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c7fff84c-64a2-4cc8-a4b6-219e7f9669ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.172246 Jun 02 16:08:28.714757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 122/235] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:28 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:28.909597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:28.910502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:28.917861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:28.918579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:28.919426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:28.919933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:29.023687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-db5a1b35-5cce-4ac0-9bec-d32dd97d0a3d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:29.025807 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-db5a1b35-5cce-4ac0-9bec-d32dd97d0a3d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:29.036921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-db5a1b35-5cce-4ac0-9bec-d32dd97d0a3d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:29.037391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-db5a1b35-5cce-4ac0-9bec-d32dd97d0a3d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:29.038185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-db5a1b35-5cce-4ac0-9bec-d32dd97d0a3d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:29.038631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-db5a1b35-5cce-4ac0-9bec-d32dd97d0a3d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:29.121983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-db5a1b35-5cce-4ac0-9bec-d32dd97d0a3d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:29.124548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:29.131937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-db5a1b35-5cce-4ac0-9bec-d32dd97d0a3d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1316 microversion: 2.1 time: 0.112314 Jun 02 16:08:29.132675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 123/236] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:29 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1316 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:29.515761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:29.525789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:29.527576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:29.528963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8b9eac85-e7c4-41f5-a4e0-06b39e581d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.623851 Jun 02 16:08:29.531036 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 114/237] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:28 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:29.733645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3281c9cb-3ead-41e2-836f-0573a21ece91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:29.735099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3281c9cb-3ead-41e2-836f-0573a21ece91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:29.742525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3281c9cb-3ead-41e2-836f-0573a21ece91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:29.743320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3281c9cb-3ead-41e2-836f-0573a21ece91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:29.744168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3281c9cb-3ead-41e2-836f-0573a21ece91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:29.744726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3281c9cb-3ead-41e2-836f-0573a21ece91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:29.880517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3281c9cb-3ead-41e2-836f-0573a21ece91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:29.889007 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3281c9cb-3ead-41e2-836f-0573a21ece91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.160803 Jun 02 16:08:29.889940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 124/238] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:29 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:30.152995 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9e71a9b8-a76a-4c3a-8ec4-010cd5b222db tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:30.155620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9e71a9b8-a76a-4c3a-8ec4-010cd5b222db tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:30.160316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9e71a9b8-a76a-4c3a-8ec4-010cd5b222db tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:30.160958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9e71a9b8-a76a-4c3a-8ec4-010cd5b222db tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:30.161743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9e71a9b8-a76a-4c3a-8ec4-010cd5b222db tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:30.162299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9e71a9b8-a76a-4c3a-8ec4-010cd5b222db tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:30.306150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9e71a9b8-a76a-4c3a-8ec4-010cd5b222db tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:30.313988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9e71a9b8-a76a-4c3a-8ec4-010cd5b222db tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.167225 Jun 02 16:08:30.314592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 115/239] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:30 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:30.549761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:30.549761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:30.557579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:30.558614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:30.559475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:30.559912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:30.707985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:30.717433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:30.718975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:30.720248 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-79042ff1-ac78-4644-b791-4a43a8bd0d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.175640 Jun 02 16:08:30.720834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 125/240] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:30 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:30.906605 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-545dd1e2-363d-49d3-81d9-f3530a94709d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:30.907233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-545dd1e2-363d-49d3-81d9-f3530a94709d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:30.913524 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-545dd1e2-363d-49d3-81d9-f3530a94709d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:30.920846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-545dd1e2-363d-49d3-81d9-f3530a94709d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:30.920846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-545dd1e2-363d-49d3-81d9-f3530a94709d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:30.920846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-545dd1e2-363d-49d3-81d9-f3530a94709d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:31.077495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-545dd1e2-363d-49d3-81d9-f3530a94709d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:31.085135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-545dd1e2-363d-49d3-81d9-f3530a94709d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.182373 Jun 02 16:08:31.085707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 116/241] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:30 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:31.332002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ca5004d9-f425-4a88-83c2-9e82532b09df tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:31.332799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ca5004d9-f425-4a88-83c2-9e82532b09df tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:31.344410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca5004d9-f425-4a88-83c2-9e82532b09df tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:31.346299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca5004d9-f425-4a88-83c2-9e82532b09df tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:31.347430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca5004d9-f425-4a88-83c2-9e82532b09df tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:31.348018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca5004d9-f425-4a88-83c2-9e82532b09df tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:31.612009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ca5004d9-f425-4a88-83c2-9e82532b09df tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:31.622436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ca5004d9-f425-4a88-83c2-9e82532b09df tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.294214 Jun 02 16:08:31.638423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 126/242] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:31 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:31.742900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:31.743591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:31.756599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:31.756920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:31.757710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:31.758193 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:32.042833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:32.062831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:32.062831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:32.066726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-f247de2c-261a-472f-89c1-7b0fdba16fc8 req-37b6eca8-321f-4220-a9cc-f4e47503e742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bf99ae-5d36-4add-b49f-746e933e19cc", "name": "network-vif-plugged", "status": "completed", "tag": "95689152-b643-4d84-9f69-18b1c5d87d13"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:08:32.085231 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1542b4be-8789-413c-85c4-67715e50ac71 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.323426 Jun 02 16:08:32.099774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-f247de2c-261a-472f-89c1-7b0fdba16fc8 req-37b6eca8-321f-4220-a9cc-f4e47503e742 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:32.101351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-f247de2c-261a-472f-89c1-7b0fdba16fc8 req-37b6eca8-321f-4220-a9cc-f4e47503e742 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:32.102311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 117/243] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:31 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:32.117755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6d7ca31b-b782-42aa-a773-d04d9e234cf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:32.125492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6d7ca31b-b782-42aa-a773-d04d9e234cf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:32.132185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6d7ca31b-b782-42aa-a773-d04d9e234cf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:32.143006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6d7ca31b-b782-42aa-a773-d04d9e234cf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:32.143006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6d7ca31b-b782-42aa-a773-d04d9e234cf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:32.143006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6d7ca31b-b782-42aa-a773-d04d9e234cf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:32.143722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-f247de2c-261a-472f-89c1-7b0fdba16fc8 req-37b6eca8-321f-4220-a9cc-f4e47503e742 service nova] Creating event network-vif-plugged:95689152-b643-4d84-9f69-18b1c5d87d13 for instance f8bf99ae-5d36-4add-b49f-746e933e19cc on hv-cinder-79760 Jun 02 16:08:32.146602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-f247de2c-261a-472f-89c1-7b0fdba16fc8 req-37b6eca8-321f-4220-a9cc-f4e47503e742 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086253 Jun 02 16:08:32.147696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 127/244] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:08:32.154876 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:32.371186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6d7ca31b-b782-42aa-a773-d04d9e234cf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:32.379026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6d7ca31b-b782-42aa-a773-d04d9e234cf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.269021 Jun 02 16:08:32.380347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 118/245] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:32 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:32.654348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fcd53040-152b-49d4-b82f-1180dea076ca tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:32.655678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fcd53040-152b-49d4-b82f-1180dea076ca tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:32.671179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fcd53040-152b-49d4-b82f-1180dea076ca tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:32.672710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fcd53040-152b-49d4-b82f-1180dea076ca tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:32.674999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fcd53040-152b-49d4-b82f-1180dea076ca tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:32.676280 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fcd53040-152b-49d4-b82f-1180dea076ca tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:32.900143 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fcd53040-152b-49d4-b82f-1180dea076ca tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:32.908682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fcd53040-152b-49d4-b82f-1180dea076ca tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.266636 Jun 02 16:08:32.909636 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 128/246] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:32 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:33.119675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:33.120522 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:33.127158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:33.127609 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:33.128377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:33.128812 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:33.348458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:33.359482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:33.372815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:33.372815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-986aaa7f-8763-436f-b248-7212524c682a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.247375 Jun 02 16:08:33.372815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 119/247] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:33 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:33.403173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5123fed8-4885-47e7-875c-6700d69ef77b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:33.403938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5123fed8-4885-47e7-875c-6700d69ef77b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:33.406313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:33.411133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5123fed8-4885-47e7-875c-6700d69ef77b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:33.411817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5123fed8-4885-47e7-875c-6700d69ef77b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:33.412592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5123fed8-4885-47e7-875c-6700d69ef77b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:33.413023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5123fed8-4885-47e7-875c-6700d69ef77b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:33.607160 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5123fed8-4885-47e7-875c-6700d69ef77b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:33.618420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5123fed8-4885-47e7-875c-6700d69ef77b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.223850 Jun 02 16:08:33.621530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 129/248] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:33 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:33.925767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4113a83e-95f3-4923-9914-ae8080537530 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:33.926408 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4113a83e-95f3-4923-9914-ae8080537530 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:33.933216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4113a83e-95f3-4923-9914-ae8080537530 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:33.933662 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4113a83e-95f3-4923-9914-ae8080537530 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:33.934451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4113a83e-95f3-4923-9914-ae8080537530 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:33.934886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4113a83e-95f3-4923-9914-ae8080537530 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:34.089858 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4113a83e-95f3-4923-9914-ae8080537530 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:34.098034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4113a83e-95f3-4923-9914-ae8080537530 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.176130 Jun 02 16:08:34.098751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 120/249] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:33 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:34.398953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:34.398953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:34.398953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:34.398953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:34.399680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:34.399680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:34.614495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:34.625312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:34.627156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:34.628713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-51e1cbbf-ee51-4e59-ad27-7a4ddc76a966 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.251611 Jun 02 16:08:34.640141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 130/250] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:34 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:34.646122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-aaf10959-53c3-4156-acbe-89cb1a24d165 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:34.647600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-aaf10959-53c3-4156-acbe-89cb1a24d165 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:34.665437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aaf10959-53c3-4156-acbe-89cb1a24d165 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:34.665437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aaf10959-53c3-4156-acbe-89cb1a24d165 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:34.665437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aaf10959-53c3-4156-acbe-89cb1a24d165 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:34.668183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aaf10959-53c3-4156-acbe-89cb1a24d165 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:34.908529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-aaf10959-53c3-4156-acbe-89cb1a24d165 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:34.918984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-aaf10959-53c3-4156-acbe-89cb1a24d165 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.277661 Jun 02 16:08:34.921519 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 121/251] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:34 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:35.115937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-63d69a6e-3975-40b1-bec4-7547f5407eb0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:35.116532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-63d69a6e-3975-40b1-bec4-7547f5407eb0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:35.123655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63d69a6e-3975-40b1-bec4-7547f5407eb0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:35.124090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63d69a6e-3975-40b1-bec4-7547f5407eb0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:35.124834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63d69a6e-3975-40b1-bec4-7547f5407eb0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:35.125261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63d69a6e-3975-40b1-bec4-7547f5407eb0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:35.371107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-63d69a6e-3975-40b1-bec4-7547f5407eb0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:35.381919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-63d69a6e-3975-40b1-bec4-7547f5407eb0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.267740 Jun 02 16:08:35.381919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 131/252] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:35 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:35.647863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:35.648563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:35.658417 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:35.661274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:35.661775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:35.662596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:35.663206 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:35.898772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:35.898772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:35.899316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:35.899316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-172b4b29-7736-48ad-a63d-1ac2f5ed476e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.225148 Jun 02 16:08:35.899316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 122/253] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:35 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:08:35.938380 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4231d6b4-397d-4aed-80cb-86bcb4f27fbf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:35.938984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4231d6b4-397d-4aed-80cb-86bcb4f27fbf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:35.945590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4231d6b4-397d-4aed-80cb-86bcb4f27fbf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:35.946340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4231d6b4-397d-4aed-80cb-86bcb4f27fbf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:35.948519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4231d6b4-397d-4aed-80cb-86bcb4f27fbf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:35.949167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4231d6b4-397d-4aed-80cb-86bcb4f27fbf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:36.121636 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4231d6b4-397d-4aed-80cb-86bcb4f27fbf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:36.130457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4231d6b4-397d-4aed-80cb-86bcb4f27fbf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.196933 Jun 02 16:08:36.131043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 132/254] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:35 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:36.397005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5a5b2fd5-15dc-41ed-9300-98b9aeec7b08 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:36.397714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5a5b2fd5-15dc-41ed-9300-98b9aeec7b08 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:36.405030 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a5b2fd5-15dc-41ed-9300-98b9aeec7b08 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:36.405477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a5b2fd5-15dc-41ed-9300-98b9aeec7b08 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:36.406281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a5b2fd5-15dc-41ed-9300-98b9aeec7b08 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:36.406919 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a5b2fd5-15dc-41ed-9300-98b9aeec7b08 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:36.551848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5a5b2fd5-15dc-41ed-9300-98b9aeec7b08 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:36.560415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5a5b2fd5-15dc-41ed-9300-98b9aeec7b08 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.167285 Jun 02 16:08:36.563609 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 123/255] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:36 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:36.912170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:36.912768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:36.919440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:36.919880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:36.920633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:36.921059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:37.101129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:37.109778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:37.113482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:37.118518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d00984a1-70ac-469a-866b-465cc5715647 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.210305 Jun 02 16:08:37.119580 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 133/256] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:36 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:37.154189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d53baaee-9ec4-47c3-aa08-69a548037bb5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:37.154803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d53baaee-9ec4-47c3-aa08-69a548037bb5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:37.162601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d53baaee-9ec4-47c3-aa08-69a548037bb5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:37.163266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d53baaee-9ec4-47c3-aa08-69a548037bb5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:37.164217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d53baaee-9ec4-47c3-aa08-69a548037bb5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:37.164807 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d53baaee-9ec4-47c3-aa08-69a548037bb5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:37.368201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d53baaee-9ec4-47c3-aa08-69a548037bb5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:37.378647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d53baaee-9ec4-47c3-aa08-69a548037bb5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.228785 Jun 02 16:08:37.389244 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 124/257] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:37 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:37.582589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-72fa85c8-8861-45d8-8407-1645c401d49c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:37.583527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-72fa85c8-8861-45d8-8407-1645c401d49c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:37.591249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-72fa85c8-8861-45d8-8407-1645c401d49c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:37.592060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-72fa85c8-8861-45d8-8407-1645c401d49c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:37.593077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-72fa85c8-8861-45d8-8407-1645c401d49c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:37.593739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-72fa85c8-8861-45d8-8407-1645c401d49c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:37.776597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-72fa85c8-8861-45d8-8407-1645c401d49c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:37.782760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-72fa85c8-8861-45d8-8407-1645c401d49c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.203895 Jun 02 16:08:37.783505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 134/258] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:37 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:38.136800 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:38.137400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:38.143982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:38.144424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:38.145171 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:38.145600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:38.311843 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:38.320035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:38.321681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:38.323514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5fb12ee2-4a97-4227-bfe3-b55615d4ffd7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.190921 Jun 02 16:08:38.324261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 125/259] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:38 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:38.397059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-89e556fe-7227-4916-9720-7304b3a0dae4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:38.397768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-89e556fe-7227-4916-9720-7304b3a0dae4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:38.406894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89e556fe-7227-4916-9720-7304b3a0dae4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:38.407720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89e556fe-7227-4916-9720-7304b3a0dae4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:38.409234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89e556fe-7227-4916-9720-7304b3a0dae4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:38.409854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89e556fe-7227-4916-9720-7304b3a0dae4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:38.557862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-89e556fe-7227-4916-9720-7304b3a0dae4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:38.575545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-89e556fe-7227-4916-9720-7304b3a0dae4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.177353 Jun 02 16:08:38.575545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 135/260] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:38 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:38.803003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-321dec80-489a-46fc-adfc-b4cbfdaf881a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:38.804029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-321dec80-489a-46fc-adfc-b4cbfdaf881a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:38.817754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-321dec80-489a-46fc-adfc-b4cbfdaf881a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:38.819025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-321dec80-489a-46fc-adfc-b4cbfdaf881a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:38.822150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-321dec80-489a-46fc-adfc-b4cbfdaf881a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:38.822644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-321dec80-489a-46fc-adfc-b4cbfdaf881a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:39.085874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-321dec80-489a-46fc-adfc-b4cbfdaf881a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:39.098031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-321dec80-489a-46fc-adfc-b4cbfdaf881a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.301485 Jun 02 16:08:39.102893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 126/261] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:38 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:39.342050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:39.342599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:39.348605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:39.349054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:39.349816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:39.350268 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:39.562683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:39.571959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:39.574437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:39.575785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-317bef63-08bb-47e3-be1d-52e713162da7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.238914 Jun 02 16:08:39.587334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 136/262] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:39 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:39.590921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-33a1c60c-04c0-4927-a9a1-8a33cd88701c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:39.591584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-33a1c60c-04c0-4927-a9a1-8a33cd88701c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:39.603477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33a1c60c-04c0-4927-a9a1-8a33cd88701c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:39.603477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33a1c60c-04c0-4927-a9a1-8a33cd88701c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:39.603477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33a1c60c-04c0-4927-a9a1-8a33cd88701c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:39.603477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33a1c60c-04c0-4927-a9a1-8a33cd88701c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:39.772813 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-33a1c60c-04c0-4927-a9a1-8a33cd88701c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:39.784467 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-33a1c60c-04c0-4927-a9a1-8a33cd88701c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.198825 Jun 02 16:08:39.785118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 127/263] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:39 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:40.127434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-84547738-2c52-4f86-b9fc-3e819820f1d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:40.128196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-84547738-2c52-4f86-b9fc-3e819820f1d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:40.137634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84547738-2c52-4f86-b9fc-3e819820f1d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:40.139373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84547738-2c52-4f86-b9fc-3e819820f1d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:40.142884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84547738-2c52-4f86-b9fc-3e819820f1d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:40.143404 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84547738-2c52-4f86-b9fc-3e819820f1d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:40.351040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-84547738-2c52-4f86-b9fc-3e819820f1d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:40.372363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-84547738-2c52-4f86-b9fc-3e819820f1d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.248356 Jun 02 16:08:40.380314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 137/264] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:40 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:40.593815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:40.594844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:40.602013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:40.602696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:40.604604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:40.605047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:40.802149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cd3d9c80-3838-4158-bf75-550f27b4a0e2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:40.802149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cd3d9c80-3838-4158-bf75-550f27b4a0e2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:40.821346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd3d9c80-3838-4158-bf75-550f27b4a0e2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:40.822799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd3d9c80-3838-4158-bf75-550f27b4a0e2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:40.828267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd3d9c80-3838-4158-bf75-550f27b4a0e2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:40.830898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd3d9c80-3838-4158-bf75-550f27b4a0e2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:40.860913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:40.872682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:40.874615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:40.875952 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d5494dc8-8701-4e78-b9c6-aa80de863a51 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.286444 Jun 02 16:08:40.876852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 128/265] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:40 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:41.003576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cd3d9c80-3838-4158-bf75-550f27b4a0e2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:41.016712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cd3d9c80-3838-4158-bf75-550f27b4a0e2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.216954 Jun 02 16:08:41.017760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 138/266] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:40 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:41.396571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f2c06776-e2e6-4e57-a933-9802566e4656 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:41.397186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f2c06776-e2e6-4e57-a933-9802566e4656 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:41.403490 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2c06776-e2e6-4e57-a933-9802566e4656 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:41.403936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2c06776-e2e6-4e57-a933-9802566e4656 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:41.404692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2c06776-e2e6-4e57-a933-9802566e4656 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:41.405250 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2c06776-e2e6-4e57-a933-9802566e4656 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:41.541646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f2c06776-e2e6-4e57-a933-9802566e4656 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:41.549387 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f2c06776-e2e6-4e57-a933-9802566e4656 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.157042 Jun 02 16:08:41.549953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 129/267] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:41 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:41.894747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:41.895356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:41.902445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:41.902896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:41.903685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:41.904105 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:42.036794 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-89918d8b-0a9f-4d5e-b8f3-d1c77bd5defe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:42.037628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-89918d8b-0a9f-4d5e-b8f3-d1c77bd5defe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:42.041736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:42.045125 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-89918d8b-0a9f-4d5e-b8f3-d1c77bd5defe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:42.045837 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-89918d8b-0a9f-4d5e-b8f3-d1c77bd5defe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:42.046774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-89918d8b-0a9f-4d5e-b8f3-d1c77bd5defe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:42.047292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-89918d8b-0a9f-4d5e-b8f3-d1c77bd5defe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:42.050436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:42.052496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:42.053686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-03f5e354-dbc3-455f-aa7d-7605087a7297 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.162890 Jun 02 16:08:42.065871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 139/268] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:41 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:42.204122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-89918d8b-0a9f-4d5e-b8f3-d1c77bd5defe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:42.213948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-89918d8b-0a9f-4d5e-b8f3-d1c77bd5defe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.180233 Jun 02 16:08:42.214565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 130/269] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:42 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:42.568299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cca1dd40-69c5-49e6-a8e4-c510d93aa09a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:42.569040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cca1dd40-69c5-49e6-a8e4-c510d93aa09a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:42.575686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cca1dd40-69c5-49e6-a8e4-c510d93aa09a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:42.576132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cca1dd40-69c5-49e6-a8e4-c510d93aa09a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:42.576889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cca1dd40-69c5-49e6-a8e4-c510d93aa09a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:42.577315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cca1dd40-69c5-49e6-a8e4-c510d93aa09a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:42.705728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cca1dd40-69c5-49e6-a8e4-c510d93aa09a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:42.714116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cca1dd40-69c5-49e6-a8e4-c510d93aa09a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.150790 Jun 02 16:08:42.714689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 140/270] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:42 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:43.073374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:43.073986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:43.080637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:43.081089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:43.081853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:43.082465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:43.215610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:43.223573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:43.225092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:43.226235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d76959c9-7904-4a60-b0a2-d120a1ac8c3a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.157357 Jun 02 16:08:43.226950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 131/271] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:43 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:43.231919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-24bb579d-667a-4ea4-8344-869a5099da89 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:43.233078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-24bb579d-667a-4ea4-8344-869a5099da89 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:43.239152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24bb579d-667a-4ea4-8344-869a5099da89 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:43.239599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24bb579d-667a-4ea4-8344-869a5099da89 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:43.240363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24bb579d-667a-4ea4-8344-869a5099da89 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:43.240791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24bb579d-667a-4ea4-8344-869a5099da89 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:43.245246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:43.379728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-24bb579d-667a-4ea4-8344-869a5099da89 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:43.387376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-24bb579d-667a-4ea4-8344-869a5099da89 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.160116 Jun 02 16:08:43.387950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 141/272] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:43 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:43.731614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fc7b94d9-f7e8-48e4-b098-1001dcf9b75c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:43.732254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fc7b94d9-f7e8-48e4-b098-1001dcf9b75c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:43.738604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc7b94d9-f7e8-48e4-b098-1001dcf9b75c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:43.739058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc7b94d9-f7e8-48e4-b098-1001dcf9b75c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:43.739998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc7b94d9-f7e8-48e4-b098-1001dcf9b75c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:43.740494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc7b94d9-f7e8-48e4-b098-1001dcf9b75c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:43.877748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fc7b94d9-f7e8-48e4-b098-1001dcf9b75c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:43.884823 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fc7b94d9-f7e8-48e4-b098-1001dcf9b75c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.157539 Jun 02 16:08:43.885511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 132/273] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:43 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:44.249274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:44.249274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:44.252571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:44.253024 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:44.253818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:44.254286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:44.396539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:44.404931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b5108ee1-bcb9-4d86-b12e-71036c27d621 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:44.406185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b5108ee1-bcb9-4d86-b12e-71036c27d621 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:44.411170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:44.412913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:44.413032 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5108ee1-bcb9-4d86-b12e-71036c27d621 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:44.413450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5108ee1-bcb9-4d86-b12e-71036c27d621 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:44.418786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bec0d7a3-2412-427a-87d6-64e926b9c1c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.172787 Jun 02 16:08:44.418908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5108ee1-bcb9-4d86-b12e-71036c27d621 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:44.418992 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 142/274] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:44 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:44.419098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5108ee1-bcb9-4d86-b12e-71036c27d621 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:44.551706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b5108ee1-bcb9-4d86-b12e-71036c27d621 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:44.559862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b5108ee1-bcb9-4d86-b12e-71036c27d621 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.159495 Jun 02 16:08:44.569705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 133/275] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:44 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:44.902539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-77ff1f25-31f9-4c7b-9528-555d5aa5e401 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:44.903199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-77ff1f25-31f9-4c7b-9528-555d5aa5e401 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:44.909374 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77ff1f25-31f9-4c7b-9528-555d5aa5e401 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:44.910243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77ff1f25-31f9-4c7b-9528-555d5aa5e401 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:44.910679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77ff1f25-31f9-4c7b-9528-555d5aa5e401 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:44.911164 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77ff1f25-31f9-4c7b-9528-555d5aa5e401 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:45.071366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-77ff1f25-31f9-4c7b-9528-555d5aa5e401 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:45.071366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-77ff1f25-31f9-4c7b-9528-555d5aa5e401 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.170765 Jun 02 16:08:45.071366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 143/276] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:44 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:45.432162 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:45.433027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:45.439240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:45.439688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:45.440464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:45.440901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:45.577502 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-80e30667-4aa3-4103-959c-20b2f2795429 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:45.578114 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-80e30667-4aa3-4103-959c-20b2f2795429 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:45.582616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:45.590219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80e30667-4aa3-4103-959c-20b2f2795429 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:45.590219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80e30667-4aa3-4103-959c-20b2f2795429 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:45.590219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80e30667-4aa3-4103-959c-20b2f2795429 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:45.590219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80e30667-4aa3-4103-959c-20b2f2795429 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:45.593853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:45.595445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:45.596563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1ea75005-c685-49a9-a9ff-46703dc594e5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.168466 Jun 02 16:08:45.597289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 134/277] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:45 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:45.728577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-80e30667-4aa3-4103-959c-20b2f2795429 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:45.736693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-80e30667-4aa3-4103-959c-20b2f2795429 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.163133 Jun 02 16:08:45.737251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 144/278] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:45 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:46.091375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a277b06e-90c6-4c70-bc79-4b03cb3b78aa tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:46.092254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a277b06e-90c6-4c70-bc79-4b03cb3b78aa tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:46.100465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a277b06e-90c6-4c70-bc79-4b03cb3b78aa tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:46.101220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a277b06e-90c6-4c70-bc79-4b03cb3b78aa tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:46.102283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a277b06e-90c6-4c70-bc79-4b03cb3b78aa tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:46.103114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a277b06e-90c6-4c70-bc79-4b03cb3b78aa tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:46.108464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:46.300290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a277b06e-90c6-4c70-bc79-4b03cb3b78aa tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:46.308455 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a277b06e-90c6-4c70-bc79-4b03cb3b78aa tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.225324 Jun 02 16:08:46.309491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 135/279] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:46 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:46.615421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:46.616087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:46.623792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:46.624234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:46.625184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:46.625621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:46.761301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4b0cdb41-98e6-4875-a361-9a483a7cb85e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:46.763674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4b0cdb41-98e6-4875-a361-9a483a7cb85e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:46.782047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b0cdb41-98e6-4875-a361-9a483a7cb85e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:46.782805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b0cdb41-98e6-4875-a361-9a483a7cb85e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:46.783896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b0cdb41-98e6-4875-a361-9a483a7cb85e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:46.784378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b0cdb41-98e6-4875-a361-9a483a7cb85e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:46.800700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:46.810906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:46.812757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:46.814107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-52f02a91-beab-4718-8888-686494236150 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.202648 Jun 02 16:08:46.814956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 145/280] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:46 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:46.933284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4b0cdb41-98e6-4875-a361-9a483a7cb85e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:46.941774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4b0cdb41-98e6-4875-a361-9a483a7cb85e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.191038 Jun 02 16:08:46.942299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 136/281] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:46 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:47.327491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4dc4174d-659f-4626-be12-36eaf18c77d7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:47.328005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4dc4174d-659f-4626-be12-36eaf18c77d7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:47.334188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4dc4174d-659f-4626-be12-36eaf18c77d7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:47.334708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4dc4174d-659f-4626-be12-36eaf18c77d7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:47.335493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4dc4174d-659f-4626-be12-36eaf18c77d7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:47.335918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4dc4174d-659f-4626-be12-36eaf18c77d7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:47.474659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4dc4174d-659f-4626-be12-36eaf18c77d7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:47.483527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4dc4174d-659f-4626-be12-36eaf18c77d7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.158741 Jun 02 16:08:47.483527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 146/282] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:47 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:47.832913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:47.833524 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:47.840655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:47.841104 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:47.842198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:47.842640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:47.962333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8b2bc7b5-fb3c-43ea-a6d6-de11cf1ae47f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:47.962868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8b2bc7b5-fb3c-43ea-a6d6-de11cf1ae47f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:47.969642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b2bc7b5-fb3c-43ea-a6d6-de11cf1ae47f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:47.970118 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b2bc7b5-fb3c-43ea-a6d6-de11cf1ae47f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:47.970917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b2bc7b5-fb3c-43ea-a6d6-de11cf1ae47f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:47.971331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b2bc7b5-fb3c-43ea-a6d6-de11cf1ae47f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:47.986909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:47.998141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:48.000600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:48.001076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0715cf32-fd45-4caa-9067-0562fb8e1c89 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.172259 Jun 02 16:08:48.001974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 137/283] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:47 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:48.130933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8b2bc7b5-fb3c-43ea-a6d6-de11cf1ae47f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:48.138487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8b2bc7b5-fb3c-43ea-a6d6-de11cf1ae47f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.180639 Jun 02 16:08:48.139058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 147/284] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:47 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:48.499076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7a937d45-4465-4492-a897-e8ddba181833 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:48.499606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7a937d45-4465-4492-a897-e8ddba181833 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:48.505427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7a937d45-4465-4492-a897-e8ddba181833 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:48.505870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7a937d45-4465-4492-a897-e8ddba181833 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:48.512244 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7a937d45-4465-4492-a897-e8ddba181833 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:48.512244 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7a937d45-4465-4492-a897-e8ddba181833 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:48.644107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7a937d45-4465-4492-a897-e8ddba181833 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:48.651607 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7a937d45-4465-4492-a897-e8ddba181833 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.156393 Jun 02 16:08:48.652160 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 138/285] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:48 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:49.018710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:49.019322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:49.025305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:49.026130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:49.026550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:49.026984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:49.157419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:49.161155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-96331640-9439-4b9f-8a12-5938351f1cc2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:49.161791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-96331640-9439-4b9f-8a12-5938351f1cc2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:49.169489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96331640-9439-4b9f-8a12-5938351f1cc2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:49.169935 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96331640-9439-4b9f-8a12-5938351f1cc2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:49.170770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96331640-9439-4b9f-8a12-5938351f1cc2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:49.171208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96331640-9439-4b9f-8a12-5938351f1cc2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:49.174226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:49.176761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:49.178198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1fd0b7bb-ae64-4714-90b9-61f763eb03a4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.163159 Jun 02 16:08:49.180792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 148/286] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:49 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:49.320445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-96331640-9439-4b9f-8a12-5938351f1cc2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:49.328600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-96331640-9439-4b9f-8a12-5938351f1cc2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.171823 Jun 02 16:08:49.329170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 139/287] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:49 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:49.668996 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c9a144df-e600-44b3-ae10-8d1a3f3cd782 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:49.669609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c9a144df-e600-44b3-ae10-8d1a3f3cd782 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:49.675627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9a144df-e600-44b3-ae10-8d1a3f3cd782 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:49.676072 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9a144df-e600-44b3-ae10-8d1a3f3cd782 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:49.676828 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9a144df-e600-44b3-ae10-8d1a3f3cd782 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:49.677261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9a144df-e600-44b3-ae10-8d1a3f3cd782 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:49.805937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c9a144df-e600-44b3-ae10-8d1a3f3cd782 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:49.814684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c9a144df-e600-44b3-ae10-8d1a3f3cd782 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.149795 Jun 02 16:08:49.815330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 149/288] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:49 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:50.201344 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:50.209974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:50.209974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:50.209974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:50.210722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:50.211301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:50.345318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-03c71818-28d8-4a1a-924f-cbacdd73f1bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:50.346194 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-03c71818-28d8-4a1a-924f-cbacdd73f1bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:50.350946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:50.352723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03c71818-28d8-4a1a-924f-cbacdd73f1bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:50.353313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03c71818-28d8-4a1a-924f-cbacdd73f1bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:50.354219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03c71818-28d8-4a1a-924f-cbacdd73f1bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:50.354659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03c71818-28d8-4a1a-924f-cbacdd73f1bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:50.359983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:50.361503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:50.362763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e0312558-7c76-47d1-97cc-b2061c8e1d25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.165778 Jun 02 16:08:50.368360 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 140/289] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:50 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:08:50.487623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-03c71818-28d8-4a1a-924f-cbacdd73f1bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:50.495171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-03c71818-28d8-4a1a-924f-cbacdd73f1bf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.153666 Jun 02 16:08:50.495739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 150/290] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:50 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:50.832339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-693aa1e7-08ee-4dc0-9440-6d76a27cbd67 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:50.832951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-693aa1e7-08ee-4dc0-9440-6d76a27cbd67 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:50.840098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-693aa1e7-08ee-4dc0-9440-6d76a27cbd67 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:50.840551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-693aa1e7-08ee-4dc0-9440-6d76a27cbd67 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:50.841312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-693aa1e7-08ee-4dc0-9440-6d76a27cbd67 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:50.841746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-693aa1e7-08ee-4dc0-9440-6d76a27cbd67 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:50.972716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-693aa1e7-08ee-4dc0-9440-6d76a27cbd67 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:50.980842 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-693aa1e7-08ee-4dc0-9440-6d76a27cbd67 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.152419 Jun 02 16:08:50.981414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 141/291] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:50 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:51.381132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:51.381776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:51.388845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:51.389291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:51.390057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:51.390515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:51.512769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-88e0ca67-b2c0-4ce5-b3bd-7697bcd2bf18 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:51.513473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-88e0ca67-b2c0-4ce5-b3bd-7697bcd2bf18 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:51.520658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-88e0ca67-b2c0-4ce5-b3bd-7697bcd2bf18 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:51.521448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-88e0ca67-b2c0-4ce5-b3bd-7697bcd2bf18 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:51.522496 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-88e0ca67-b2c0-4ce5-b3bd-7697bcd2bf18 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:51.523165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-88e0ca67-b2c0-4ce5-b3bd-7697bcd2bf18 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:51.534153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:51.545010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:51.546915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:51.548386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3d960f2a-eb0b-40cb-a268-6749fa9930d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.172401 Jun 02 16:08:51.550718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 151/292] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:51 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:08:51.669790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-88e0ca67-b2c0-4ce5-b3bd-7697bcd2bf18 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:51.677486 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-88e0ca67-b2c0-4ce5-b3bd-7697bcd2bf18 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.169916 Jun 02 16:08:51.678181 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 142/293] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:51 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:51.997296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3f45ccd1-bda1-4b51-b1af-a03260b679d0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:51.997906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3f45ccd1-bda1-4b51-b1af-a03260b679d0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:52.004186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3f45ccd1-bda1-4b51-b1af-a03260b679d0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:52.004633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3f45ccd1-bda1-4b51-b1af-a03260b679d0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:52.005442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3f45ccd1-bda1-4b51-b1af-a03260b679d0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:52.005878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3f45ccd1-bda1-4b51-b1af-a03260b679d0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:52.131789 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3f45ccd1-bda1-4b51-b1af-a03260b679d0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:52.139220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3f45ccd1-bda1-4b51-b1af-a03260b679d0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.146522 Jun 02 16:08:52.139781 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 152/294] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:51 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:52.566911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:52.567523 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:52.574983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:52.575430 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:52.576203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:52.576639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:52.695486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dea86343-4525-430c-8613-aefd10fe4fe3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:52.696638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dea86343-4525-430c-8613-aefd10fe4fe3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:52.705663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dea86343-4525-430c-8613-aefd10fe4fe3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:52.706317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dea86343-4525-430c-8613-aefd10fe4fe3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:52.709477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dea86343-4525-430c-8613-aefd10fe4fe3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:52.709477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dea86343-4525-430c-8613-aefd10fe4fe3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:52.727459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:52.736659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:52.738144 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:52.739409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cb050b22-9d14-4526-a7c8-2b36b95b48c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.176590 Jun 02 16:08:52.739976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 143/295] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:52 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:52.851604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-dea86343-4525-430c-8613-aefd10fe4fe3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:52.859739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dea86343-4525-430c-8613-aefd10fe4fe3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.168070 Jun 02 16:08:52.860458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 153/296] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:52 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:53.157992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-657710b2-d2bc-4fa5-84e9-9167c80620c0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:53.158834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-657710b2-d2bc-4fa5-84e9-9167c80620c0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:53.165081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-657710b2-d2bc-4fa5-84e9-9167c80620c0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:53.165527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-657710b2-d2bc-4fa5-84e9-9167c80620c0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:53.166436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-657710b2-d2bc-4fa5-84e9-9167c80620c0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:53.171131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-657710b2-d2bc-4fa5-84e9-9167c80620c0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:53.310203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-657710b2-d2bc-4fa5-84e9-9167c80620c0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:53.317457 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-657710b2-d2bc-4fa5-84e9-9167c80620c0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.164753 Jun 02 16:08:53.318025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 144/297] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:53 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:53.757056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:53.757664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:53.765059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:53.765504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:53.766311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:53.766750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:53.878834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-404865db-6ca5-4710-a136-b3adffded93a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:53.879504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-404865db-6ca5-4710-a136-b3adffded93a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:53.887796 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-404865db-6ca5-4710-a136-b3adffded93a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:53.888500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-404865db-6ca5-4710-a136-b3adffded93a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:53.889297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-404865db-6ca5-4710-a136-b3adffded93a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:53.889739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-404865db-6ca5-4710-a136-b3adffded93a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:53.903224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:53.911302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:53.912862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:53.913954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3798300a-d272-4d92-8f04-5a93cd03d5ef tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.160940 Jun 02 16:08:53.914535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 154/298] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:53 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:54.023845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-404865db-6ca5-4710-a136-b3adffded93a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:54.031768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-404865db-6ca5-4710-a136-b3adffded93a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.157607 Jun 02 16:08:54.041220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 145/299] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:53 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:54.333982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-37fb8075-4555-48cf-854d-56e6953b86a2 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:54.334644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-37fb8075-4555-48cf-854d-56e6953b86a2 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:54.343263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37fb8075-4555-48cf-854d-56e6953b86a2 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:54.343263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37fb8075-4555-48cf-854d-56e6953b86a2 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:54.343263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37fb8075-4555-48cf-854d-56e6953b86a2 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:54.343263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37fb8075-4555-48cf-854d-56e6953b86a2 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:54.477207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-37fb8075-4555-48cf-854d-56e6953b86a2 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:54.485741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-37fb8075-4555-48cf-854d-56e6953b86a2 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.155522 Jun 02 16:08:54.486515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 155/300] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:54 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:54.936626 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:54.938222 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:54.946424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:54.947534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:54.948486 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:54.948932 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:55.049168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-83691669-6993-4aef-9080-098ec637e076 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:55.049772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-83691669-6993-4aef-9080-098ec637e076 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:55.056565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83691669-6993-4aef-9080-098ec637e076 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:55.057862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83691669-6993-4aef-9080-098ec637e076 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:55.058724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83691669-6993-4aef-9080-098ec637e076 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:55.059155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83691669-6993-4aef-9080-098ec637e076 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:55.326248 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-83691669-6993-4aef-9080-098ec637e076 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:55.334743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-83691669-6993-4aef-9080-098ec637e076 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.289597 Jun 02 16:08:55.335755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 156/301] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:55 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:55.503231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ec05780f-a4e2-4d67-8c79-4c26ad449682 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:55.503836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ec05780f-a4e2-4d67-8c79-4c26ad449682 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:55.520568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ec05780f-a4e2-4d67-8c79-4c26ad449682 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:55.527852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ec05780f-a4e2-4d67-8c79-4c26ad449682 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:55.528695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ec05780f-a4e2-4d67-8c79-4c26ad449682 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:55.529131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ec05780f-a4e2-4d67-8c79-4c26ad449682 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:55.538328 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:55.576048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:55.584897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:55.586065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e77a092d-4c64-4d98-b548-3d2adacc0ce6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.657106 Jun 02 16:08:55.586674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 146/302] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:54 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:08:55.701381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ec05780f-a4e2-4d67-8c79-4c26ad449682 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:55.703694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:55.711242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ec05780f-a4e2-4d67-8c79-4c26ad449682 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.212207 Jun 02 16:08:55.711815 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 157/303] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:55 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:56.118067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-d8cef937-c7e5-4de9-a222-61d1a4b7e313 req-0a8e9cff-a50b-4e02-92d5-f19e4730eeca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4649971-cb55-4c10-83c7-e0831c1d9a2b", "tag": "f1a43f7e-70f3-4a67-af40-e30955976d64"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:08:56.141872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-d8cef937-c7e5-4de9-a222-61d1a4b7e313 req-0a8e9cff-a50b-4e02-92d5-f19e4730eeca service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:56.142451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-d8cef937-c7e5-4de9-a222-61d1a4b7e313 req-0a8e9cff-a50b-4e02-92d5-f19e4730eeca service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:56.159224 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-d8cef937-c7e5-4de9-a222-61d1a4b7e313 req-0a8e9cff-a50b-4e02-92d5-f19e4730eeca service nova] Creating event network-changed:f1a43f7e-70f3-4a67-af40-e30955976d64 for instance b4649971-cb55-4c10-83c7-e0831c1d9a2b on hv-cinder-79760 Jun 02 16:08:56.167567 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-d8cef937-c7e5-4de9-a222-61d1a4b7e313 req-0a8e9cff-a50b-4e02-92d5-f19e4730eeca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053282 Jun 02 16:08:56.170699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 147/304] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:08:56.352831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fbfdd49d-c9f8-4ce0-a48f-61fa88d5f10f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:56.353440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fbfdd49d-c9f8-4ce0-a48f-61fa88d5f10f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:56.359467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fbfdd49d-c9f8-4ce0-a48f-61fa88d5f10f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:56.359910 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fbfdd49d-c9f8-4ce0-a48f-61fa88d5f10f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:56.360663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fbfdd49d-c9f8-4ce0-a48f-61fa88d5f10f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:56.361094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fbfdd49d-c9f8-4ce0-a48f-61fa88d5f10f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:56.496794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fbfdd49d-c9f8-4ce0-a48f-61fa88d5f10f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:56.504265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fbfdd49d-c9f8-4ce0-a48f-61fa88d5f10f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.155702 Jun 02 16:08:56.504824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 158/305] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:56 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:56.605482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:56.606325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:56.612554 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:56.613084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:56.613933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:56.614559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:56.732818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-93d3d74b-dd3c-491d-b2db-f6b381444f91 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:56.733425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-93d3d74b-dd3c-491d-b2db-f6b381444f91 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:56.741054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-93d3d74b-dd3c-491d-b2db-f6b381444f91 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:56.745286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-93d3d74b-dd3c-491d-b2db-f6b381444f91 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:56.745286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-93d3d74b-dd3c-491d-b2db-f6b381444f91 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:56.745286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-93d3d74b-dd3c-491d-b2db-f6b381444f91 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:56.764665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:56.772931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:56.774749 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:56.776885 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d315533a-ccca-4d17-94a6-c092a3b5fa88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.175692 Jun 02 16:08:56.777521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 148/306] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:56 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:56.888098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-93d3d74b-dd3c-491d-b2db-f6b381444f91 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:56.896018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-93d3d74b-dd3c-491d-b2db-f6b381444f91 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.167222 Jun 02 16:08:56.896682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 159/307] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:56 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:57.521994 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5465cb13-86be-434c-bf21-10771cc21aed tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:57.522630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5465cb13-86be-434c-bf21-10771cc21aed tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:57.529229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5465cb13-86be-434c-bf21-10771cc21aed tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:57.529735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5465cb13-86be-434c-bf21-10771cc21aed tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:57.530626 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5465cb13-86be-434c-bf21-10771cc21aed tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:57.530950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5465cb13-86be-434c-bf21-10771cc21aed tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:57.665086 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5465cb13-86be-434c-bf21-10771cc21aed tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:57.672719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5465cb13-86be-434c-bf21-10771cc21aed tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.154452 Jun 02 16:08:57.673377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 149/308] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:57 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:57.795415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:57.796152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:57.802525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:57.802967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:57.803715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:57.804142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:57.912806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e3b8112b-8d40-48f7-bd1c-c303a56ebd6d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:57.913529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e3b8112b-8d40-48f7-bd1c-c303a56ebd6d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:57.920704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e3b8112b-8d40-48f7-bd1c-c303a56ebd6d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:57.921158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e3b8112b-8d40-48f7-bd1c-c303a56ebd6d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:57.921933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e3b8112b-8d40-48f7-bd1c-c303a56ebd6d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:57.922430 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e3b8112b-8d40-48f7-bd1c-c303a56ebd6d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:57.976153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:57.984917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:57.986596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:57.990522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f901f99c-2541-48ec-873e-2895fc30bc46 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.196900 Jun 02 16:08:57.990522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 160/309] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:57 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:58.112525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e3b8112b-8d40-48f7-bd1c-c303a56ebd6d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:58.120745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e3b8112b-8d40-48f7-bd1c-c303a56ebd6d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.211805 Jun 02 16:08:58.121362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 150/310] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:57 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:58.690631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9bb849a3-b6c0-4d5c-9edd-d1ac27938ca8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:58.691235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9bb849a3-b6c0-4d5c-9edd-d1ac27938ca8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:58.697662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9bb849a3-b6c0-4d5c-9edd-d1ac27938ca8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:58.698679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9bb849a3-b6c0-4d5c-9edd-d1ac27938ca8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:58.699439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9bb849a3-b6c0-4d5c-9edd-d1ac27938ca8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:58.699869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9bb849a3-b6c0-4d5c-9edd-d1ac27938ca8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:58.843123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9bb849a3-b6c0-4d5c-9edd-d1ac27938ca8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:58.850565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9bb849a3-b6c0-4d5c-9edd-d1ac27938ca8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.163613 Jun 02 16:08:58.851135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 161/311] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:58 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:08:59.005983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:59.006701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:59.013954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:59.014482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:59.015283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:59.021113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:59.139149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-81c75b47-806d-4905-8648-3f49afdf9d6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:59.139779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-81c75b47-806d-4905-8648-3f49afdf9d6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:59.147445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-81c75b47-806d-4905-8648-3f49afdf9d6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:59.147848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-81c75b47-806d-4905-8648-3f49afdf9d6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:59.148628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-81c75b47-806d-4905-8648-3f49afdf9d6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:59.149070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-81c75b47-806d-4905-8648-3f49afdf9d6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:59.153377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:59.163368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:59.164968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:59.166696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0a31b7e7-7d29-448d-9347-ea4bb5d1edc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.164374 Jun 02 16:08:59.174131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 151/312] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:08:59 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:08:59.292451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-81c75b47-806d-4905-8648-3f49afdf9d6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:08:59.309556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-81c75b47-806d-4905-8648-3f49afdf9d6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.175608 Jun 02 16:08:59.311267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 162/313] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:59 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:08:59.867681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c3f11839-879c-4a9f-b676-8315335abd2c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:08:59.868388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c3f11839-879c-4a9f-b676-8315335abd2c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:08:59.874809 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c3f11839-879c-4a9f-b676-8315335abd2c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:59.875259 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c3f11839-879c-4a9f-b676-8315335abd2c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:59.876034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c3f11839-879c-4a9f-b676-8315335abd2c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:08:59.876473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c3f11839-879c-4a9f-b676-8315335abd2c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:08:59.891247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:00.010393 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c3f11839-879c-4a9f-b676-8315335abd2c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:00.019084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c3f11839-879c-4a9f-b676-8315335abd2c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.155220 Jun 02 16:09:00.019688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 152/314] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:08:59 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:00.184671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:00.185303 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:00.191397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:00.191880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:00.192605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:00.193057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:00.329260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ba26efdb-09ff-4d20-be3d-e0ec45cba11d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:00.331057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ba26efdb-09ff-4d20-be3d-e0ec45cba11d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:00.334702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:00.340318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ba26efdb-09ff-4d20-be3d-e0ec45cba11d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:00.340879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ba26efdb-09ff-4d20-be3d-e0ec45cba11d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:00.342036 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ba26efdb-09ff-4d20-be3d-e0ec45cba11d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:00.342622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ba26efdb-09ff-4d20-be3d-e0ec45cba11d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:00.347297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:00.350428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:00.351574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-22620f9e-0822-4469-b92b-049e5f0b62fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.170856 Jun 02 16:09:00.362821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 163/315] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:09:00 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:09:00.485752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ba26efdb-09ff-4d20-be3d-e0ec45cba11d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:00.493515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ba26efdb-09ff-4d20-be3d-e0ec45cba11d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.169595 Jun 02 16:09:00.494215 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 153/316] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:00 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:09:01.037808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8f084dd3-91ab-465d-aa6e-ea94c879df2b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:01.038453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8f084dd3-91ab-465d-aa6e-ea94c879df2b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:01.044674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f084dd3-91ab-465d-aa6e-ea94c879df2b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:01.045119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f084dd3-91ab-465d-aa6e-ea94c879df2b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:01.045876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f084dd3-91ab-465d-aa6e-ea94c879df2b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:01.046342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f084dd3-91ab-465d-aa6e-ea94c879df2b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:01.175647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8f084dd3-91ab-465d-aa6e-ea94c879df2b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:01.183270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8f084dd3-91ab-465d-aa6e-ea94c879df2b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.149285 Jun 02 16:09:01.183829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 164/317] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:01 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:01.368807 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:01.369485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:01.376105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:01.376551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:01.377312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:01.377746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:01.507952 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:01.512255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-62a22782-664c-47fc-aa8a-462a9a2e1c21 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:01.513406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-62a22782-664c-47fc-aa8a-462a9a2e1c21 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:01.516853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:01.518421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:01.519352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62a22782-664c-47fc-aa8a-462a9a2e1c21 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:01.519564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-01b48ac6-a474-407e-ad52-6f7c200337bd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.154555 Jun 02 16:09:01.519792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62a22782-664c-47fc-aa8a-462a9a2e1c21 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:01.520117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 154/318] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:09:01 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:09:01.521389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62a22782-664c-47fc-aa8a-462a9a2e1c21 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:01.521842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62a22782-664c-47fc-aa8a-462a9a2e1c21 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:01.655165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-62a22782-664c-47fc-aa8a-462a9a2e1c21 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:01.662850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-62a22782-664c-47fc-aa8a-462a9a2e1c21 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.155201 Jun 02 16:09:01.663414 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 165/319] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:01 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:09:02.204067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-13f8438d-8392-4ad3-b1a7-16ebb2805a91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:02.204067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-13f8438d-8392-4ad3-b1a7-16ebb2805a91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:02.207943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13f8438d-8392-4ad3-b1a7-16ebb2805a91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:02.208389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13f8438d-8392-4ad3-b1a7-16ebb2805a91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:02.209162 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13f8438d-8392-4ad3-b1a7-16ebb2805a91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:02.209703 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13f8438d-8392-4ad3-b1a7-16ebb2805a91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:02.351860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-13f8438d-8392-4ad3-b1a7-16ebb2805a91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:02.360250 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-13f8438d-8392-4ad3-b1a7-16ebb2805a91 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.164527 Jun 02 16:09:02.360803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 155/320] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:02 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:02.538025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:02.538641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:02.545389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:02.545840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:02.546644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:02.547075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:02.680352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-975c005c-0967-4b45-8626-46c2a1f1299c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:02.681061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-975c005c-0967-4b45-8626-46c2a1f1299c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:02.683846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:02.687733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-975c005c-0967-4b45-8626-46c2a1f1299c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:02.688176 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-975c005c-0967-4b45-8626-46c2a1f1299c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:02.688937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-975c005c-0967-4b45-8626-46c2a1f1299c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:02.689358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-975c005c-0967-4b45-8626-46c2a1f1299c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:02.692458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:02.694049 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:02.695278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a10402d0-c009-442e-a652-7f144bdcba42 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.161122 Jun 02 16:09:02.695912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 166/321] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:09:02 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:09:02.825283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-975c005c-0967-4b45-8626-46c2a1f1299c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:02.832850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-975c005c-0967-4b45-8626-46c2a1f1299c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.156304 Jun 02 16:09:02.833416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 156/322] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:02 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:09:03.377962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3c497b8f-3780-4604-a617-f4cbfca97ff4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:03.378605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3c497b8f-3780-4604-a617-f4cbfca97ff4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:03.385374 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c497b8f-3780-4604-a617-f4cbfca97ff4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:03.386030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c497b8f-3780-4604-a617-f4cbfca97ff4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:03.386879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c497b8f-3780-4604-a617-f4cbfca97ff4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:03.387297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c497b8f-3780-4604-a617-f4cbfca97ff4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:03.535567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3c497b8f-3780-4604-a617-f4cbfca97ff4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:03.543732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3c497b8f-3780-4604-a617-f4cbfca97ff4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.169589 Jun 02 16:09:03.544305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 167/323] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:03 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:03.716353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:03.717000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:03.724635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:03.725564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:03.726917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:03.727541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:03.850436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5f7e9cff-47ac-43e8-a886-f0e0dc040e6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:03.851051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5f7e9cff-47ac-43e8-a886-f0e0dc040e6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:03.857693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5f7e9cff-47ac-43e8-a886-f0e0dc040e6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:03.858215 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5f7e9cff-47ac-43e8-a886-f0e0dc040e6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:03.859009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5f7e9cff-47ac-43e8-a886-f0e0dc040e6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:03.859440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5f7e9cff-47ac-43e8-a886-f0e0dc040e6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:03.917984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:03.927149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:03.928821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:03.929937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-899bb58e-8fc5-4da1-bf8e-2f09e5eb92b8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.219139 Jun 02 16:09:03.932362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 157/324] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:09:03 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:09:04.022877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5f7e9cff-47ac-43e8-a886-f0e0dc040e6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:04.033500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5f7e9cff-47ac-43e8-a886-f0e0dc040e6a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.186540 Jun 02 16:09:04.034494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 168/325] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:03 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:09:04.561311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-07bb19a4-7c69-4c07-90bc-313bf728e8e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:04.561931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-07bb19a4-7c69-4c07-90bc-313bf728e8e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:04.568142 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07bb19a4-7c69-4c07-90bc-313bf728e8e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:04.568596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07bb19a4-7c69-4c07-90bc-313bf728e8e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:04.569371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07bb19a4-7c69-4c07-90bc-313bf728e8e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:04.569812 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07bb19a4-7c69-4c07-90bc-313bf728e8e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:04.720347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-07bb19a4-7c69-4c07-90bc-313bf728e8e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:04.729063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-07bb19a4-7c69-4c07-90bc-313bf728e8e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1503 microversion: 2.1 time: 0.171824 Jun 02 16:09:04.729623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 158/326] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:04 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:04.748360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49e74a10-a517-428b-bda6-7aab1ab56d33"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:09:04.749744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:04.756213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:04.758442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:04.758442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:04.758442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:04.829065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] HTTP exception thrown: Cannot 'attach_volume' instance fc302fd8-397a-45ed-9316-d78c9f5b324a while it is in vm_state rescued Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Request method failure captured: Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: POST /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a/os-volume_attachments HTTP/1.1 Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 74 Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOAO7LmHqb4S_f4qwkNYdaHIV121i5tIUgTvVzS00aYcMN7m5pOkeLk6zCuP0R6IV1y0MhhoRJeqYPLyhsXvbyg4WsnBPK6GU_Ip3YjrFLh8AS5JLVg_uIYrdxD1j654pRlGuETGhlXxCeeVYcAJWrmuY6ublaGdQg5AuSzUoIcy7hc Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:09:04.831364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_629a7b91ffc64154a55a45415f739949"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/629a7b91ffc64154a55a45415f739949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}] Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: a8658730ea2a4a06b7b4070976c6397f Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {"volumeAttachment": {"volumeId": "49e74a10-a517-428b-bda6-7aab1ab56d33"}} Jun 02 16:09:04.832778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Cannot 'attach_volume' instance fc302fd8-397a-45ed-9316-d78c9f5b324a while it is in vm_state rescued Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'server_id': 'fc302fd8-397a-45ed-9316-d78c9f5b324a', 'body': {'volumeAttachment': {'volumeId': '49e74a10-a517-428b-bda6-7aab1ab56d33'}}} Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fc302fd8-397a-45ed-9316-d78c9f5b324a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:09:04.833489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fc302fd8-397a-45ed-9316-d78c9f5b324a while it is in vm_state rescued Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:09:04.834670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:09:04.835722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:09:04.835722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:09:04.835722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fc302fd8-397a-45ed-9316-d78c9f5b324a while it is in vm_state rescued Jun 02 16:09:04.835722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:09:04.835722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Returning 409 to user: Cannot 'attach_volume' instance fc302fd8-397a-45ed-9316-d78c9f5b324a while it is in vm_state rescued {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:09:04.835722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8e47618e-0ec8-4baa-873a-e810fc4c3fb2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.089852 Jun 02 16:09:04.835722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 169/327] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:09:04 2022] POST /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 02 16:09:04.844123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f8bd8178-9bdd-4ce9-a6b6-3733232a6bc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:09:04.849263 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f8bd8178-9bdd-4ce9-a6b6-3733232a6bc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:04.851085 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8bd8178-9bdd-4ce9-a6b6-3733232a6bc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:04.851536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8bd8178-9bdd-4ce9-a6b6-3733232a6bc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:04.852349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8bd8178-9bdd-4ce9-a6b6-3733232a6bc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:04.852747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8bd8178-9bdd-4ce9-a6b6-3733232a6bc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:04.953646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:04.954271 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:04.961813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:04.962292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:04.963335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:04.964108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:05.106807 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:05.116915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:05.118787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:05.121310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8e4ab096-ef70-4974-b708-f306411ebb41 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.171522 Jun 02 16:09:05.122667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 170/328] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:09:04 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:09:05.131361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c1fc1844-6306-4f8c-8053-8a7a1ddf2a13 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:05.131361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c1fc1844-6306-4f8c-8053-8a7a1ddf2a13 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:05.133996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f8bd8178-9bdd-4ce9-a6b6-3733232a6bc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a/action" status: 202 len: 0 microversion: 2.1 time: 0.293386 Jun 02 16:09:05.135756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 159/329] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:09:04 2022] POST /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:09:05.140050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:05.142210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1fc1844-6306-4f8c-8053-8a7a1ddf2a13 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:05.142962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1fc1844-6306-4f8c-8053-8a7a1ddf2a13 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:05.144076 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1fc1844-6306-4f8c-8053-8a7a1ddf2a13 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:05.144806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1fc1844-6306-4f8c-8053-8a7a1ddf2a13 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:05.144941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8732b44c-85b2-44fd-af8e-8d9a8166707a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:05.145985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8732b44c-85b2-44fd-af8e-8d9a8166707a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:05.157825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8732b44c-85b2-44fd-af8e-8d9a8166707a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:05.158413 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8732b44c-85b2-44fd-af8e-8d9a8166707a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:05.159255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8732b44c-85b2-44fd-af8e-8d9a8166707a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:05.159870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8732b44c-85b2-44fd-af8e-8d9a8166707a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:05.297001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c1fc1844-6306-4f8c-8053-8a7a1ddf2a13 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:05.304478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c1fc1844-6306-4f8c-8053-8a7a1ddf2a13 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.180116 Jun 02 16:09:05.305292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 171/330] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:05 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:05.307566 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8732b44c-85b2-44fd-af8e-8d9a8166707a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:05.319061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8732b44c-85b2-44fd-af8e-8d9a8166707a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.178345 Jun 02 16:09:05.319792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 160/331] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:05 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:09:06.141649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:06.142264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:06.148346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:06.148785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:06.149526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:06.149955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:06.285262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:06.293302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:06.294855 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:06.295937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c8d02916-f637-421e-b489-64d5978bbe0a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.158097 Jun 02 16:09:06.296479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 172/332] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:09:06 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:09:06.321389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f8c8a5a1-f8e5-472a-b2d2-fc96eff4477c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:06.322744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f8c8a5a1-f8e5-472a-b2d2-fc96eff4477c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:06.330415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8c8a5a1-f8e5-472a-b2d2-fc96eff4477c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:06.330870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8c8a5a1-f8e5-472a-b2d2-fc96eff4477c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:06.331635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8c8a5a1-f8e5-472a-b2d2-fc96eff4477c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:06.332076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8c8a5a1-f8e5-472a-b2d2-fc96eff4477c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:06.339596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-748528b9-4815-44b9-8348-60b7a7300081 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:06.340193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-748528b9-4815-44b9-8348-60b7a7300081 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:06.346119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-748528b9-4815-44b9-8348-60b7a7300081 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:06.346561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-748528b9-4815-44b9-8348-60b7a7300081 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:06.347310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-748528b9-4815-44b9-8348-60b7a7300081 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:06.347735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-748528b9-4815-44b9-8348-60b7a7300081 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:06.477322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f8c8a5a1-f8e5-472a-b2d2-fc96eff4477c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:06.482755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-748528b9-4815-44b9-8348-60b7a7300081 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:06.485902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f8c8a5a1-f8e5-472a-b2d2-fc96eff4477c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.169019 Jun 02 16:09:06.486722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 161/333] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:06 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:06.490456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-748528b9-4815-44b9-8348-60b7a7300081 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.155370 Jun 02 16:09:06.491029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 173/334] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:06 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:09:07.313870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:07.314420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:07.320797 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:07.321260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:07.322303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:07.322877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:07.514169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:07.514169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:07.515169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:07.515169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c93c1cf8-2066-46f8-af52-70d1e3f2e0b1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.165130 Jun 02 16:09:07.515169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 162/335] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:09:07 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:09:07.515452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0661e872-67c5-43fa-832d-d07415f3d59e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:07.515452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0661e872-67c5-43fa-832d-d07415f3d59e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:07.515922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4f39ac39-93f8-4533-a2fe-e804db4ab6d2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:07.515922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4f39ac39-93f8-4533-a2fe-e804db4ab6d2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:07.516101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0661e872-67c5-43fa-832d-d07415f3d59e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:07.516101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0661e872-67c5-43fa-832d-d07415f3d59e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:07.516101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0661e872-67c5-43fa-832d-d07415f3d59e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:07.516101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0661e872-67c5-43fa-832d-d07415f3d59e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:07.519704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f39ac39-93f8-4533-a2fe-e804db4ab6d2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:07.520226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f39ac39-93f8-4533-a2fe-e804db4ab6d2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:07.521268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f39ac39-93f8-4533-a2fe-e804db4ab6d2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:07.521781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f39ac39-93f8-4533-a2fe-e804db4ab6d2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:07.661976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0661e872-67c5-43fa-832d-d07415f3d59e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:07.664919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:07.672376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0661e872-67c5-43fa-832d-d07415f3d59e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.172152 Jun 02 16:09:07.672971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 174/336] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:07 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:07.700694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4f39ac39-93f8-4533-a2fe-e804db4ab6d2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:07.708924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4f39ac39-93f8-4533-a2fe-e804db4ab6d2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.204122 Jun 02 16:09:07.709478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 163/337] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:07 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:08.510937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:08.511538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:08.517993 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:08.518605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:08.519205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:08.519650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:08.659967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:08.668493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:08.669997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:08.671106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4a5a8f81-e29a-4d69-96ef-4fe385635227 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1403 microversion: 2.20 time: 0.164125 Jun 02 16:09:08.671663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 175/338] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:09:08 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1403 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:09:08.692445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e1ec37e6-5fd5-4294-81ac-d2fa94341d8d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:08.693069 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e1ec37e6-5fd5-4294-81ac-d2fa94341d8d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:08.695677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=84 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:08.700896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e1ec37e6-5fd5-4294-81ac-d2fa94341d8d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:08.701341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e1ec37e6-5fd5-4294-81ac-d2fa94341d8d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:08.702153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e1ec37e6-5fd5-4294-81ac-d2fa94341d8d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:08.702592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e1ec37e6-5fd5-4294-81ac-d2fa94341d8d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:08.733694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-009fe57d-9147-44e3-acab-37a9b9349b40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:08.737091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-009fe57d-9147-44e3-acab-37a9b9349b40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:08.741493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-009fe57d-9147-44e3-acab-37a9b9349b40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:08.741938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-009fe57d-9147-44e3-acab-37a9b9349b40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:08.742734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-009fe57d-9147-44e3-acab-37a9b9349b40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:08.743156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-009fe57d-9147-44e3-acab-37a9b9349b40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:08.843278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e1ec37e6-5fd5-4294-81ac-d2fa94341d8d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:08.861548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e1ec37e6-5fd5-4294-81ac-d2fa94341d8d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.172641 Jun 02 16:09:08.863353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 164/339] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:08 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:08.898530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-009fe57d-9147-44e3-acab-37a9b9349b40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:08.906744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-009fe57d-9147-44e3-acab-37a9b9349b40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.183091 Jun 02 16:09:08.907520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 176/340] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:08 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:09.688586 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:09.689190 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:09.696176 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:09.696818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:09.697615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:09.698084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:09.833366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:09.842512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:09.844067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:09.845225 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-55bfeca3-70f4-4c4c-9c0b-f3ddc7959b76 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1596 microversion: 2.20 time: 0.160744 Jun 02 16:09:09.845818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 165/341] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:09:09 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1596 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:09:09.862661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-60bb1fd6-cb0c-4847-b65a-3044a7cd2e47 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:09.863141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-60bb1fd6-cb0c-4847-b65a-3044a7cd2e47 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:09.869269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-60bb1fd6-cb0c-4847-b65a-3044a7cd2e47 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:09.869709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-60bb1fd6-cb0c-4847-b65a-3044a7cd2e47 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:09.870508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-60bb1fd6-cb0c-4847-b65a-3044a7cd2e47 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:09.870942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-60bb1fd6-cb0c-4847-b65a-3044a7cd2e47 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:09.886613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9c8d02df-bbda-47c1-a18f-811b89be1e87 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:09.887228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9c8d02df-bbda-47c1-a18f-811b89be1e87 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:09.893145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c8d02df-bbda-47c1-a18f-811b89be1e87 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:09.893595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c8d02df-bbda-47c1-a18f-811b89be1e87 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:09.894391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c8d02df-bbda-47c1-a18f-811b89be1e87 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:09.894841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c8d02df-bbda-47c1-a18f-811b89be1e87 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:09.960017 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-60bb1fd6-cb0c-4847-b65a-3044a7cd2e47 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101063 Jun 02 16:09:09.960609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 177/342] 10.222.0.59 () {60 vars in 1315 bytes} [Thu Jun 2 16:09:09 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:09:09.966477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5b073f20-07fc-4ef6-80f8-214676cab778 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:09.967089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5b073f20-07fc-4ef6-80f8-214676cab778 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:09.973986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b073f20-07fc-4ef6-80f8-214676cab778 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:09.974479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b073f20-07fc-4ef6-80f8-214676cab778 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:09.975257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b073f20-07fc-4ef6-80f8-214676cab778 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:09.975695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b073f20-07fc-4ef6-80f8-214676cab778 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:10.038150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9c8d02df-bbda-47c1-a18f-811b89be1e87 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:10.046114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9c8d02df-bbda-47c1-a18f-811b89be1e87 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.163946 Jun 02 16:09:10.046760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 166/343] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:09 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:10.408818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5b073f20-07fc-4ef6-80f8-214676cab778 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:10.416629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5b073f20-07fc-4ef6-80f8-214676cab778 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.454852 Jun 02 16:09:10.417340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 178/344] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:09 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:11.075157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-14757f70-ad94-4287-b35e-dbb9b4124ae6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:11.075157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-14757f70-ad94-4287-b35e-dbb9b4124ae6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:11.078695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14757f70-ad94-4287-b35e-dbb9b4124ae6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:11.079159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14757f70-ad94-4287-b35e-dbb9b4124ae6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:11.079926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14757f70-ad94-4287-b35e-dbb9b4124ae6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:11.080365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14757f70-ad94-4287-b35e-dbb9b4124ae6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:11.223664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-14757f70-ad94-4287-b35e-dbb9b4124ae6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:11.233665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-14757f70-ad94-4287-b35e-dbb9b4124ae6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.166278 Jun 02 16:09:11.234355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 167/345] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:11 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:11.433882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bb9699de-00dc-4fe7-89aa-f8670a2f6ae8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:11.434515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bb9699de-00dc-4fe7-89aa-f8670a2f6ae8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:11.440764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb9699de-00dc-4fe7-89aa-f8670a2f6ae8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:11.441205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb9699de-00dc-4fe7-89aa-f8670a2f6ae8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:11.442001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb9699de-00dc-4fe7-89aa-f8670a2f6ae8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:11.442452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb9699de-00dc-4fe7-89aa-f8670a2f6ae8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:11.623524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bb9699de-00dc-4fe7-89aa-f8670a2f6ae8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:11.632111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bb9699de-00dc-4fe7-89aa-f8670a2f6ae8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.201969 Jun 02 16:09:11.642091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 179/346] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:11 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:11.814770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-085a0ac4-4f88-4bcb-9e03-ea460a0b87aa req-8b562f6e-5517-4f33-870b-8c9802ba097d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bf99ae-5d36-4add-b49f-746e933e19cc", "tag": "95689152-b643-4d84-9f69-18b1c5d87d13"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:09:11.823321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-085a0ac4-4f88-4bcb-9e03-ea460a0b87aa req-8b562f6e-5517-4f33-870b-8c9802ba097d service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:11.823775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-085a0ac4-4f88-4bcb-9e03-ea460a0b87aa req-8b562f6e-5517-4f33-870b-8c9802ba097d service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:11.827525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:11.835073 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-085a0ac4-4f88-4bcb-9e03-ea460a0b87aa req-8b562f6e-5517-4f33-870b-8c9802ba097d service nova] Creating event network-changed:95689152-b643-4d84-9f69-18b1c5d87d13 for instance f8bf99ae-5d36-4add-b49f-746e933e19cc on hv-cinder-79760 Jun 02 16:09:11.841157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-085a0ac4-4f88-4bcb-9e03-ea460a0b87aa req-8b562f6e-5517-4f33-870b-8c9802ba097d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089294 Jun 02 16:09:11.841974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 168/347] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:09:12.251065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4fbad0e2-8b19-470d-9743-641c0452d133 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:12.251715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4fbad0e2-8b19-470d-9743-641c0452d133 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:12.258295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4fbad0e2-8b19-470d-9743-641c0452d133 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:12.258778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4fbad0e2-8b19-470d-9743-641c0452d133 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:12.260216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4fbad0e2-8b19-470d-9743-641c0452d133 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:12.260970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4fbad0e2-8b19-470d-9743-641c0452d133 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:12.411803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4fbad0e2-8b19-470d-9743-641c0452d133 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:12.419691 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4fbad0e2-8b19-470d-9743-641c0452d133 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.172640 Jun 02 16:09:12.429340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 180/348] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:12 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:12.651045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ee9b9d4f-c47c-42cb-904f-96a247f1b25e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:12.651929 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ee9b9d4f-c47c-42cb-904f-96a247f1b25e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:12.659176 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee9b9d4f-c47c-42cb-904f-96a247f1b25e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:12.659622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee9b9d4f-c47c-42cb-904f-96a247f1b25e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:12.666489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee9b9d4f-c47c-42cb-904f-96a247f1b25e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:12.666489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee9b9d4f-c47c-42cb-904f-96a247f1b25e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:12.796947 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ee9b9d4f-c47c-42cb-904f-96a247f1b25e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:12.804810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ee9b9d4f-c47c-42cb-904f-96a247f1b25e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.159089 Jun 02 16:09:12.805400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 169/349] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:12 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:13.437323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0341793d-4667-48f8-95cf-dfe6929063a0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:13.437934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0341793d-4667-48f8-95cf-dfe6929063a0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:13.443988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0341793d-4667-48f8-95cf-dfe6929063a0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:13.444432 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0341793d-4667-48f8-95cf-dfe6929063a0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:13.445200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0341793d-4667-48f8-95cf-dfe6929063a0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:13.445648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0341793d-4667-48f8-95cf-dfe6929063a0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:13.574494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0341793d-4667-48f8-95cf-dfe6929063a0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:13.581984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0341793d-4667-48f8-95cf-dfe6929063a0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.148417 Jun 02 16:09:13.582777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 181/350] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:13 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:13.822347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-00425082-ed2d-4ded-a47f-1619cac25313 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:13.822984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-00425082-ed2d-4ded-a47f-1619cac25313 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:13.829495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-00425082-ed2d-4ded-a47f-1619cac25313 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:13.829946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-00425082-ed2d-4ded-a47f-1619cac25313 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:13.830745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-00425082-ed2d-4ded-a47f-1619cac25313 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:13.831180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-00425082-ed2d-4ded-a47f-1619cac25313 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:14.094604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-00425082-ed2d-4ded-a47f-1619cac25313 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:14.102137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-00425082-ed2d-4ded-a47f-1619cac25313 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.283871 Jun 02 16:09:14.102764 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 170/351] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:13 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:14.599344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-50f265d6-0900-4b8d-8f66-28ed6a845322 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:14.600587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-50f265d6-0900-4b8d-8f66-28ed6a845322 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:14.606053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50f265d6-0900-4b8d-8f66-28ed6a845322 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:14.606540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50f265d6-0900-4b8d-8f66-28ed6a845322 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:14.607321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50f265d6-0900-4b8d-8f66-28ed6a845322 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:14.607802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50f265d6-0900-4b8d-8f66-28ed6a845322 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:14.841279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-50f265d6-0900-4b8d-8f66-28ed6a845322 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:14.849496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-50f265d6-0900-4b8d-8f66-28ed6a845322 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.253938 Jun 02 16:09:14.850067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 182/352] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:14 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:15.121953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-76418e02-a4db-4ea5-acac-d54f96b05715 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:15.122828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-76418e02-a4db-4ea5-acac-d54f96b05715 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:15.129394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76418e02-a4db-4ea5-acac-d54f96b05715 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:15.129964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76418e02-a4db-4ea5-acac-d54f96b05715 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:15.130887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76418e02-a4db-4ea5-acac-d54f96b05715 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:15.131511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76418e02-a4db-4ea5-acac-d54f96b05715 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:15.287191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-76418e02-a4db-4ea5-acac-d54f96b05715 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:15.296867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-76418e02-a4db-4ea5-acac-d54f96b05715 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.180779 Jun 02 16:09:15.297688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 171/353] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:15 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:15.866540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bdadd260-42eb-4a31-a0da-02e662bb8e65 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:15.867077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bdadd260-42eb-4a31-a0da-02e662bb8e65 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:15.873242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bdadd260-42eb-4a31-a0da-02e662bb8e65 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:15.873695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bdadd260-42eb-4a31-a0da-02e662bb8e65 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:15.874517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bdadd260-42eb-4a31-a0da-02e662bb8e65 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:15.874954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bdadd260-42eb-4a31-a0da-02e662bb8e65 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:16.000434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bdadd260-42eb-4a31-a0da-02e662bb8e65 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:16.007785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bdadd260-42eb-4a31-a0da-02e662bb8e65 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.145158 Jun 02 16:09:16.008347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 183/354] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:15 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:16.315549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6e785184-db2d-4208-b0a5-a5e65161ff57 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:16.316191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6e785184-db2d-4208-b0a5-a5e65161ff57 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:16.323240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6e785184-db2d-4208-b0a5-a5e65161ff57 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:16.323745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6e785184-db2d-4208-b0a5-a5e65161ff57 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:16.324547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6e785184-db2d-4208-b0a5-a5e65161ff57 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:16.325019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6e785184-db2d-4208-b0a5-a5e65161ff57 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:16.456441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6e785184-db2d-4208-b0a5-a5e65161ff57 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:16.464225 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6e785184-db2d-4208-b0a5-a5e65161ff57 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.152604 Jun 02 16:09:16.464782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 172/355] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:16 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:17.024661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-28030d62-ea01-4ba2-b0f0-fbffb98d362f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:17.025769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-28030d62-ea01-4ba2-b0f0-fbffb98d362f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:17.031904 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-28030d62-ea01-4ba2-b0f0-fbffb98d362f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:17.032348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-28030d62-ea01-4ba2-b0f0-fbffb98d362f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:17.033104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-28030d62-ea01-4ba2-b0f0-fbffb98d362f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:17.033533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-28030d62-ea01-4ba2-b0f0-fbffb98d362f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:17.161832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-28030d62-ea01-4ba2-b0f0-fbffb98d362f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:17.169979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-28030d62-ea01-4ba2-b0f0-fbffb98d362f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.149113 Jun 02 16:09:17.170587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 184/356] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:17 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:17.480563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c4b8388b-42ab-42db-87dd-759479ff6daf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:17.481224 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c4b8388b-42ab-42db-87dd-759479ff6daf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:17.488029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4b8388b-42ab-42db-87dd-759479ff6daf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:17.488530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4b8388b-42ab-42db-87dd-759479ff6daf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:17.489375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4b8388b-42ab-42db-87dd-759479ff6daf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:17.489804 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4b8388b-42ab-42db-87dd-759479ff6daf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:17.620954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c4b8388b-42ab-42db-87dd-759479ff6daf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:17.628678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c4b8388b-42ab-42db-87dd-759479ff6daf tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.151945 Jun 02 16:09:17.629238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 173/357] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:17 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:18.187871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a6bede15-124d-4c38-a01f-d929e1d4480c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:18.188420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a6bede15-124d-4c38-a01f-d929e1d4480c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:18.194464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6bede15-124d-4c38-a01f-d929e1d4480c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:18.194914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6bede15-124d-4c38-a01f-d929e1d4480c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:18.195678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6bede15-124d-4c38-a01f-d929e1d4480c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:18.196110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6bede15-124d-4c38-a01f-d929e1d4480c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:18.326001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a6bede15-124d-4c38-a01f-d929e1d4480c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:18.333484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a6bede15-124d-4c38-a01f-d929e1d4480c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.149556 Jun 02 16:09:18.334042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 185/358] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:18 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:18.646276 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b0c10399-54dd-4dc7-ae95-2932396a74fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:18.646882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b0c10399-54dd-4dc7-ae95-2932396a74fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:18.654390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b0c10399-54dd-4dc7-ae95-2932396a74fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:18.654829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b0c10399-54dd-4dc7-ae95-2932396a74fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:18.655582 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b0c10399-54dd-4dc7-ae95-2932396a74fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:18.656011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b0c10399-54dd-4dc7-ae95-2932396a74fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:18.788887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b0c10399-54dd-4dc7-ae95-2932396a74fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:18.796553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b0c10399-54dd-4dc7-ae95-2932396a74fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.154113 Jun 02 16:09:18.797109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 174/359] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:18 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:19.350857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-15d17547-d080-4321-bde7-652030ef00e0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:19.351462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-15d17547-d080-4321-bde7-652030ef00e0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:19.357480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15d17547-d080-4321-bde7-652030ef00e0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:19.357922 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15d17547-d080-4321-bde7-652030ef00e0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:19.358714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15d17547-d080-4321-bde7-652030ef00e0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:19.359141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15d17547-d080-4321-bde7-652030ef00e0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:19.487056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-15d17547-d080-4321-bde7-652030ef00e0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:19.495197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-15d17547-d080-4321-bde7-652030ef00e0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.148007 Jun 02 16:09:19.495762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 186/360] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:19 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:19.814638 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9bbd2afa-963d-46e0-b7da-fa6606947599 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:19.815254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9bbd2afa-963d-46e0-b7da-fa6606947599 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:19.822738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9bbd2afa-963d-46e0-b7da-fa6606947599 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:19.823192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9bbd2afa-963d-46e0-b7da-fa6606947599 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:19.823959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9bbd2afa-963d-46e0-b7da-fa6606947599 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:19.824398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9bbd2afa-963d-46e0-b7da-fa6606947599 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:19.954327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9bbd2afa-963d-46e0-b7da-fa6606947599 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:19.961918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9bbd2afa-963d-46e0-b7da-fa6606947599 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.151135 Jun 02 16:09:19.962504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 175/361] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:19 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:20.511323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fff08230-238b-4428-b029-4020f73ce5c7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:20.511898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fff08230-238b-4428-b029-4020f73ce5c7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:20.517871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fff08230-238b-4428-b029-4020f73ce5c7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:20.518360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fff08230-238b-4428-b029-4020f73ce5c7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:20.519131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fff08230-238b-4428-b029-4020f73ce5c7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:20.519562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fff08230-238b-4428-b029-4020f73ce5c7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:20.652500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fff08230-238b-4428-b029-4020f73ce5c7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:20.659810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fff08230-238b-4428-b029-4020f73ce5c7 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.152688 Jun 02 16:09:20.660398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 187/362] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:20 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:20.979929 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cd7d4aa4-ed53-4567-9323-625ade702292 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:20.980546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cd7d4aa4-ed53-4567-9323-625ade702292 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:20.987164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd7d4aa4-ed53-4567-9323-625ade702292 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:20.987618 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd7d4aa4-ed53-4567-9323-625ade702292 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:20.988423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd7d4aa4-ed53-4567-9323-625ade702292 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:20.988866 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd7d4aa4-ed53-4567-9323-625ade702292 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:21.117151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cd7d4aa4-ed53-4567-9323-625ade702292 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:21.125105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cd7d4aa4-ed53-4567-9323-625ade702292 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.149830 Jun 02 16:09:21.125654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 176/363] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:20 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:21.677132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-970a30d2-93a8-414f-bcad-f11551acf22b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:21.677742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-970a30d2-93a8-414f-bcad-f11551acf22b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:21.684054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-970a30d2-93a8-414f-bcad-f11551acf22b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:21.684529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-970a30d2-93a8-414f-bcad-f11551acf22b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:21.685290 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-970a30d2-93a8-414f-bcad-f11551acf22b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:21.685730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-970a30d2-93a8-414f-bcad-f11551acf22b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:21.814529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-970a30d2-93a8-414f-bcad-f11551acf22b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:21.823164 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-970a30d2-93a8-414f-bcad-f11551acf22b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.149522 Jun 02 16:09:21.823673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 188/364] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:21 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:22.141949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-80d22b69-228f-4bd1-a151-3b52e2301fe7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:22.142591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-80d22b69-228f-4bd1-a151-3b52e2301fe7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:22.149042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80d22b69-228f-4bd1-a151-3b52e2301fe7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:22.149488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80d22b69-228f-4bd1-a151-3b52e2301fe7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:22.152522 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80d22b69-228f-4bd1-a151-3b52e2301fe7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:22.152961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80d22b69-228f-4bd1-a151-3b52e2301fe7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:22.286692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-80d22b69-228f-4bd1-a151-3b52e2301fe7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:22.294348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-80d22b69-228f-4bd1-a151-3b52e2301fe7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.156182 Jun 02 16:09:22.294917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 177/365] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:22 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:22.839977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b33e671f-28e8-4f79-9158-02a8903c78a5 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:22.840581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b33e671f-28e8-4f79-9158-02a8903c78a5 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:22.846446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b33e671f-28e8-4f79-9158-02a8903c78a5 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:22.846887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b33e671f-28e8-4f79-9158-02a8903c78a5 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:22.847632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b33e671f-28e8-4f79-9158-02a8903c78a5 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:22.848055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b33e671f-28e8-4f79-9158-02a8903c78a5 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:22.979600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b33e671f-28e8-4f79-9158-02a8903c78a5 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:22.987128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b33e671f-28e8-4f79-9158-02a8903c78a5 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.151224 Jun 02 16:09:22.987696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 189/366] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:22 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:23.311880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-041e7b6c-d1da-4a14-b0ee-9adffe23a2f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:23.312487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-041e7b6c-d1da-4a14-b0ee-9adffe23a2f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:23.318964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-041e7b6c-d1da-4a14-b0ee-9adffe23a2f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:23.319405 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-041e7b6c-d1da-4a14-b0ee-9adffe23a2f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:23.320158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-041e7b6c-d1da-4a14-b0ee-9adffe23a2f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:23.320588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-041e7b6c-d1da-4a14-b0ee-9adffe23a2f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:23.449027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-041e7b6c-d1da-4a14-b0ee-9adffe23a2f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:23.456385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-041e7b6c-d1da-4a14-b0ee-9adffe23a2f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.148305 Jun 02 16:09:23.456978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 178/367] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:23 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:24.004119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-104f01c4-3df2-42e5-b6f6-3d072b0271b4 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:24.004691 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-104f01c4-3df2-42e5-b6f6-3d072b0271b4 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:24.010731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-104f01c4-3df2-42e5-b6f6-3d072b0271b4 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:24.011180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-104f01c4-3df2-42e5-b6f6-3d072b0271b4 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:24.011940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-104f01c4-3df2-42e5-b6f6-3d072b0271b4 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:24.012374 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-104f01c4-3df2-42e5-b6f6-3d072b0271b4 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:24.136994 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-104f01c4-3df2-42e5-b6f6-3d072b0271b4 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:24.144316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-104f01c4-3df2-42e5-b6f6-3d072b0271b4 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.144176 Jun 02 16:09:24.144883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 190/368] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:23 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:24.474034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ba3c5a8b-81b9-4c8b-8eb6-dcb5637c7674 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:24.474699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ba3c5a8b-81b9-4c8b-8eb6-dcb5637c7674 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:24.481999 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ba3c5a8b-81b9-4c8b-8eb6-dcb5637c7674 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:24.482472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ba3c5a8b-81b9-4c8b-8eb6-dcb5637c7674 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:24.483228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ba3c5a8b-81b9-4c8b-8eb6-dcb5637c7674 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:24.483660 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ba3c5a8b-81b9-4c8b-8eb6-dcb5637c7674 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:24.621412 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ba3c5a8b-81b9-4c8b-8eb6-dcb5637c7674 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:24.628855 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ba3c5a8b-81b9-4c8b-8eb6-dcb5637c7674 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.158614 Jun 02 16:09:24.629417 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 179/369] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:24 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:25.161764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c894b1d9-cc12-428e-8bbc-c42eaf99ef18 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:25.162345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c894b1d9-cc12-428e-8bbc-c42eaf99ef18 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:25.168905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c894b1d9-cc12-428e-8bbc-c42eaf99ef18 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:25.169357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c894b1d9-cc12-428e-8bbc-c42eaf99ef18 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:25.170149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c894b1d9-cc12-428e-8bbc-c42eaf99ef18 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:25.170582 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c894b1d9-cc12-428e-8bbc-c42eaf99ef18 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:25.299469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c894b1d9-cc12-428e-8bbc-c42eaf99ef18 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:25.301606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:25.307951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c894b1d9-cc12-428e-8bbc-c42eaf99ef18 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.150087 Jun 02 16:09:25.308506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 191/370] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:25 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:25.645159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-643dad2d-1037-4d3a-805f-7e858ade284e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:25.645773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-643dad2d-1037-4d3a-805f-7e858ade284e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:25.652571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-643dad2d-1037-4d3a-805f-7e858ade284e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:25.653025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-643dad2d-1037-4d3a-805f-7e858ade284e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:25.653793 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-643dad2d-1037-4d3a-805f-7e858ade284e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:25.654265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-643dad2d-1037-4d3a-805f-7e858ade284e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:25.785038 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-643dad2d-1037-4d3a-805f-7e858ade284e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:25.793109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-643dad2d-1037-4d3a-805f-7e858ade284e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.151747 Jun 02 16:09:25.793674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 180/371] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:25 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:26.325621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9ddfe478-ec14-4c4c-bd84-61b93b3341d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:26.326191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9ddfe478-ec14-4c4c-bd84-61b93b3341d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:26.332233 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ddfe478-ec14-4c4c-bd84-61b93b3341d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:26.332668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ddfe478-ec14-4c4c-bd84-61b93b3341d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:26.333459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ddfe478-ec14-4c4c-bd84-61b93b3341d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:26.333881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ddfe478-ec14-4c4c-bd84-61b93b3341d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:26.466671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9ddfe478-ec14-4c4c-bd84-61b93b3341d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:26.473979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9ddfe478-ec14-4c4c-bd84-61b93b3341d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.153134 Jun 02 16:09:26.474579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 192/372] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:26 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:26.810836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-190f2eb4-86ce-4dde-846c-5099019ed937 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:26.811452 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-190f2eb4-86ce-4dde-846c-5099019ed937 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:26.818033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-190f2eb4-86ce-4dde-846c-5099019ed937 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:26.818515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-190f2eb4-86ce-4dde-846c-5099019ed937 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:26.819303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-190f2eb4-86ce-4dde-846c-5099019ed937 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:26.819744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-190f2eb4-86ce-4dde-846c-5099019ed937 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:26.953423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-190f2eb4-86ce-4dde-846c-5099019ed937 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:26.961116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-190f2eb4-86ce-4dde-846c-5099019ed937 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.155036 Jun 02 16:09:26.961684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 181/373] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:26 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:27.491061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-84b28139-5e58-4159-8a30-709352e453f9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:27.491654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-84b28139-5e58-4159-8a30-709352e453f9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:27.497674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84b28139-5e58-4159-8a30-709352e453f9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:27.498151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84b28139-5e58-4159-8a30-709352e453f9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:27.498915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84b28139-5e58-4159-8a30-709352e453f9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:27.499350 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84b28139-5e58-4159-8a30-709352e453f9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:27.696971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-84b28139-5e58-4159-8a30-709352e453f9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:27.708847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-84b28139-5e58-4159-8a30-709352e453f9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.219854 Jun 02 16:09:27.708847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 193/374] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:27 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:27.978896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ea31f002-9520-48f8-b6d0-f771472f9a70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:27.979628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ea31f002-9520-48f8-b6d0-f771472f9a70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:27.986059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea31f002-9520-48f8-b6d0-f771472f9a70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:27.986564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea31f002-9520-48f8-b6d0-f771472f9a70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:27.987335 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea31f002-9520-48f8-b6d0-f771472f9a70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:27.987772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea31f002-9520-48f8-b6d0-f771472f9a70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:28.129563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ea31f002-9520-48f8-b6d0-f771472f9a70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:28.137304 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ea31f002-9520-48f8-b6d0-f771472f9a70 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.162437 Jun 02 16:09:28.137959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 182/375] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:27 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:28.724579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1d87d2c4-cc65-4bc4-ad17-76bf25248f38 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:28.725196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1d87d2c4-cc65-4bc4-ad17-76bf25248f38 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:28.733895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1d87d2c4-cc65-4bc4-ad17-76bf25248f38 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:28.734089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1d87d2c4-cc65-4bc4-ad17-76bf25248f38 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:28.734834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1d87d2c4-cc65-4bc4-ad17-76bf25248f38 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:28.735308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1d87d2c4-cc65-4bc4-ad17-76bf25248f38 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:28.873199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1d87d2c4-cc65-4bc4-ad17-76bf25248f38 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:28.880684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1d87d2c4-cc65-4bc4-ad17-76bf25248f38 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.159914 Jun 02 16:09:28.881243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 194/376] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:28 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:29.154382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c9aa1898-41e4-4b91-9b94-cb3570f97809 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:29.154997 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c9aa1898-41e4-4b91-9b94-cb3570f97809 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:29.161546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c9aa1898-41e4-4b91-9b94-cb3570f97809 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:29.161944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c9aa1898-41e4-4b91-9b94-cb3570f97809 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:29.162743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c9aa1898-41e4-4b91-9b94-cb3570f97809 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:29.163174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c9aa1898-41e4-4b91-9b94-cb3570f97809 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:29.305134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c9aa1898-41e4-4b91-9b94-cb3570f97809 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:29.313279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c9aa1898-41e4-4b91-9b94-cb3570f97809 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.162702 Jun 02 16:09:29.313837 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 183/377] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:29 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:29.898408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bcb51a20-c023-42d4-b403-e2d432e03e99 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:29.899041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bcb51a20-c023-42d4-b403-e2d432e03e99 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:29.905167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcb51a20-c023-42d4-b403-e2d432e03e99 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:29.905632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcb51a20-c023-42d4-b403-e2d432e03e99 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:29.906425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcb51a20-c023-42d4-b403-e2d432e03e99 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:29.906854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcb51a20-c023-42d4-b403-e2d432e03e99 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:30.034805 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bcb51a20-c023-42d4-b403-e2d432e03e99 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:30.042616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bcb51a20-c023-42d4-b403-e2d432e03e99 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.148106 Jun 02 16:09:30.043191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 195/378] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:29 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:30.330229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-84003aea-1085-4186-b7ce-3d61b3e274e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:30.330988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-84003aea-1085-4186-b7ce-3d61b3e274e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:30.337965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84003aea-1085-4186-b7ce-3d61b3e274e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:30.338709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84003aea-1085-4186-b7ce-3d61b3e274e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:30.339472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84003aea-1085-4186-b7ce-3d61b3e274e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:30.339898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84003aea-1085-4186-b7ce-3d61b3e274e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:30.467750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-84003aea-1085-4186-b7ce-3d61b3e274e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:30.475441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-84003aea-1085-4186-b7ce-3d61b3e274e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.149137 Jun 02 16:09:30.476009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 184/379] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:30 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:30.742669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-1413b740-48ca-4e2a-b983-74d7b4579e6f req-65bbcdee-d001-41c9-8948-c8677f18efeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4649971-cb55-4c10-83c7-e0831c1d9a2b", "name": "network-vif-plugged", "status": "completed", "tag": "f1a43f7e-70f3-4a67-af40-e30955976d64"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:09:30.751319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-1413b740-48ca-4e2a-b983-74d7b4579e6f req-65bbcdee-d001-41c9-8948-c8677f18efeb service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:30.751755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-1413b740-48ca-4e2a-b983-74d7b4579e6f req-65bbcdee-d001-41c9-8948-c8677f18efeb service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:30.763236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-1413b740-48ca-4e2a-b983-74d7b4579e6f req-65bbcdee-d001-41c9-8948-c8677f18efeb service nova] Creating event network-vif-plugged:f1a43f7e-70f3-4a67-af40-e30955976d64 for instance b4649971-cb55-4c10-83c7-e0831c1d9a2b on hv-cinder-79760 Jun 02 16:09:30.768219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-1413b740-48ca-4e2a-b983-74d7b4579e6f req-65bbcdee-d001-41c9-8948-c8677f18efeb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029161 Jun 02 16:09:30.768798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 196/380] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:09:31.059520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fd77476d-c783-491d-8554-443fb7ac8b29 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:31.060126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fd77476d-c783-491d-8554-443fb7ac8b29 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:31.066053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd77476d-c783-491d-8554-443fb7ac8b29 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:31.066559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd77476d-c783-491d-8554-443fb7ac8b29 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:31.067338 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd77476d-c783-491d-8554-443fb7ac8b29 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:31.067766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd77476d-c783-491d-8554-443fb7ac8b29 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:31.082204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:31.199450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fd77476d-c783-491d-8554-443fb7ac8b29 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:31.209454 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fd77476d-c783-491d-8554-443fb7ac8b29 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.154369 Jun 02 16:09:31.210032 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 185/381] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:31 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:31.493625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-55dc9b79-561d-45e1-aaa7-efb10115bfd0 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:31.494364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-55dc9b79-561d-45e1-aaa7-efb10115bfd0 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:31.500520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55dc9b79-561d-45e1-aaa7-efb10115bfd0 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:31.500971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55dc9b79-561d-45e1-aaa7-efb10115bfd0 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:31.501736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55dc9b79-561d-45e1-aaa7-efb10115bfd0 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:31.502197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55dc9b79-561d-45e1-aaa7-efb10115bfd0 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:31.635126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-55dc9b79-561d-45e1-aaa7-efb10115bfd0 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:31.642748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-55dc9b79-561d-45e1-aaa7-efb10115bfd0 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.153434 Jun 02 16:09:31.643313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 197/382] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:31 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:32.228634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3ed18f87-2b65-44c4-b4d8-06c1d9f2bd19 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:32.229468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3ed18f87-2b65-44c4-b4d8-06c1d9f2bd19 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:32.236122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3ed18f87-2b65-44c4-b4d8-06c1d9f2bd19 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:32.236580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3ed18f87-2b65-44c4-b4d8-06c1d9f2bd19 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:32.237352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3ed18f87-2b65-44c4-b4d8-06c1d9f2bd19 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:32.237794 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3ed18f87-2b65-44c4-b4d8-06c1d9f2bd19 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:32.378388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3ed18f87-2b65-44c4-b4d8-06c1d9f2bd19 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:32.385997 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3ed18f87-2b65-44c4-b4d8-06c1d9f2bd19 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.161690 Jun 02 16:09:32.386685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 186/383] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:32 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:32.660889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c970cf9e-2a4f-4e58-a37d-51b8ef10f459 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:32.661408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c970cf9e-2a4f-4e58-a37d-51b8ef10f459 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:32.668478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c970cf9e-2a4f-4e58-a37d-51b8ef10f459 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:32.668924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c970cf9e-2a4f-4e58-a37d-51b8ef10f459 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:32.669682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c970cf9e-2a4f-4e58-a37d-51b8ef10f459 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:32.670142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c970cf9e-2a4f-4e58-a37d-51b8ef10f459 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:32.798928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c970cf9e-2a4f-4e58-a37d-51b8ef10f459 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:32.806385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c970cf9e-2a4f-4e58-a37d-51b8ef10f459 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1511 microversion: 2.1 time: 0.149404 Jun 02 16:09:32.806959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 198/384] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:32 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:33.402516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3a499cdb-1238-476e-9497-98702b159a07 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:33.405830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3a499cdb-1238-476e-9497-98702b159a07 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:33.409613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3a499cdb-1238-476e-9497-98702b159a07 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:33.410284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3a499cdb-1238-476e-9497-98702b159a07 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:33.411067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3a499cdb-1238-476e-9497-98702b159a07 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:33.411508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3a499cdb-1238-476e-9497-98702b159a07 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:33.566818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3a499cdb-1238-476e-9497-98702b159a07 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:33.574617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3a499cdb-1238-476e-9497-98702b159a07 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.175900 Jun 02 16:09:33.575276 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 187/385] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:33 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:33.823476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9a8784bd-91c3-40de-a77e-05ff76856173 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:33.824091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9a8784bd-91c3-40de-a77e-05ff76856173 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:33.830766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a8784bd-91c3-40de-a77e-05ff76856173 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:33.831455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a8784bd-91c3-40de-a77e-05ff76856173 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:33.832399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a8784bd-91c3-40de-a77e-05ff76856173 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:33.833123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a8784bd-91c3-40de-a77e-05ff76856173 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:33.984018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9a8784bd-91c3-40de-a77e-05ff76856173 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:33.992621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9a8784bd-91c3-40de-a77e-05ff76856173 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1517 microversion: 2.1 time: 0.173544 Jun 02 16:09:33.993198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 199/386] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:33 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:34.597161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-170dd856-3003-4752-a270-2ce9a0a886d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:34.597161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-170dd856-3003-4752-a270-2ce9a0a886d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:34.608151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-170dd856-3003-4752-a270-2ce9a0a886d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:34.608607 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-170dd856-3003-4752-a270-2ce9a0a886d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:34.609441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-170dd856-3003-4752-a270-2ce9a0a886d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:34.609995 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-170dd856-3003-4752-a270-2ce9a0a886d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:34.774553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-170dd856-3003-4752-a270-2ce9a0a886d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:34.782874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-170dd856-3003-4752-a270-2ce9a0a886d8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.195361 Jun 02 16:09:34.783448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 188/387] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:34 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:09:35.800016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-86bcbacc-ef6b-41c0-a5f0-707a26447b20 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:35.800657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-86bcbacc-ef6b-41c0-a5f0-707a26447b20 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:35.802644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=58 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:35.807391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86bcbacc-ef6b-41c0-a5f0-707a26447b20 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:35.807835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86bcbacc-ef6b-41c0-a5f0-707a26447b20 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:35.808594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86bcbacc-ef6b-41c0-a5f0-707a26447b20 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:35.809048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86bcbacc-ef6b-41c0-a5f0-707a26447b20 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:35.938934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-86bcbacc-ef6b-41c0-a5f0-707a26447b20 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:35.946831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-86bcbacc-ef6b-41c0-a5f0-707a26447b20 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1358 microversion: 2.1 time: 0.150311 Jun 02 16:09:35.947524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 200/388] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:35 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:36.964280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e393d7ce-a42c-4b69-bdde-bd7353956b10 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:36.964910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e393d7ce-a42c-4b69-bdde-bd7353956b10 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:36.971845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e393d7ce-a42c-4b69-bdde-bd7353956b10 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:36.972304 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e393d7ce-a42c-4b69-bdde-bd7353956b10 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:36.973116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e393d7ce-a42c-4b69-bdde-bd7353956b10 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:36.973537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e393d7ce-a42c-4b69-bdde-bd7353956b10 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:37.104223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e393d7ce-a42c-4b69-bdde-bd7353956b10 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:37.111664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e393d7ce-a42c-4b69-bdde-bd7353956b10 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1548 microversion: 2.1 time: 0.151716 Jun 02 16:09:37.112238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 189/389] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:36 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:37.129332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-669e8183-1bad-43c0-b27e-9cfbe20b9216 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:37.133084 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-669e8183-1bad-43c0-b27e-9cfbe20b9216 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:37.136904 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-669e8183-1bad-43c0-b27e-9cfbe20b9216 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:37.137350 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-669e8183-1bad-43c0-b27e-9cfbe20b9216 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:37.138139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-669e8183-1bad-43c0-b27e-9cfbe20b9216 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:37.138572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-669e8183-1bad-43c0-b27e-9cfbe20b9216 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:37.293323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-669e8183-1bad-43c0-b27e-9cfbe20b9216 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:37.300757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-669e8183-1bad-43c0-b27e-9cfbe20b9216 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1548 microversion: 2.1 time: 0.175188 Jun 02 16:09:37.301313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 201/390] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:37 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:37.316189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-adb746dc-d096-44d1-aad0-34b872908df1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:37.319722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-adb746dc-d096-44d1-aad0-34b872908df1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:37.320490 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-adb746dc-d096-44d1-aad0-34b872908df1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Searching by: {'deleted': False, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906'} {{(pid=118257) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 02 16:09:37.327242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-adb746dc-d096-44d1-aad0-34b872908df1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:37.327685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-adb746dc-d096-44d1-aad0-34b872908df1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:37.328480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-adb746dc-d096-44d1-aad0-34b872908df1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:37.329084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-adb746dc-d096-44d1-aad0-34b872908df1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:37.428076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.multi_cell_list [None req-adb746dc-d096-44d1-aad0-34b872908df1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 02 16:09:37.520797 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-adb746dc-d096-44d1-aad0-34b872908df1 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208177 Jun 02 16:09:37.521284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 190/391] 10.222.0.59 () {58 vars in 1124 bytes} [Thu Jun 2 16:09:37 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:09:37.532138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-af681647-a6a1-4135-8d72-2503515c713c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:37.532751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-af681647-a6a1-4135-8d72-2503515c713c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:37.538820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af681647-a6a1-4135-8d72-2503515c713c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:37.539260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af681647-a6a1-4135-8d72-2503515c713c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:37.540011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af681647-a6a1-4135-8d72-2503515c713c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:37.540619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af681647-a6a1-4135-8d72-2503515c713c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:37.670740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-af681647-a6a1-4135-8d72-2503515c713c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:37.678020 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-af681647-a6a1-4135-8d72-2503515c713c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1548 microversion: 2.1 time: 0.149618 Jun 02 16:09:37.678610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 202/392] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:37 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:37.880316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-319ca91f-433d-4e1c-8a7f-145507b5e597 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'create', calling method: .version_select at 0x7f2d5c438c10>, body: {"keypair": {"name": "tempest-keypair-506868210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFd/kfM0XFMH8zflaIgtNyGYsGkW1vcyyiPqmHbubTQICItwYIG5f1OeWkKM3qPnMzRPt13tGI2iuubABJ22cP8f7OAsdg7OnO0jzNAgoRmrw9uB7SXGGvkjyhUI3o4Kw=="}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:09:37.894718 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-319ca91f-433d-4e1c-8a7f-145507b5e597 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Getting quotas for project 629a7b91ffc64154a55a45415f739949. Resources: {'key_pairs'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:09:37.898382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-319ca91f-433d-4e1c-8a7f-145507b5e597 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Getting quotas for user a8658730ea2a4a06b7b4070976c6397f and project 629a7b91ffc64154a55a45415f739949. Resources: {'key_pairs'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:09:38.009812 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-319ca91f-433d-4e1c-8a7f-145507b5e597 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133333 Jun 02 16:09:38.011182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 191/393] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 2 16:09:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:09:40.706376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1987788854", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57598317-0238-4159-9273-26c98b610fc0"}], "security_groups": [{"name": "tempest-securitygroup--1032627316"}], "key_name": "tempest-keypair-506868210", "user_data": "}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:09:40.818758 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.network.neutron [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] validate_networks() for [('57598317-0238-4159-9273-26c98b610fc0', None, None, None, None, None)] {{(pid=118256) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:09:41.183638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Flavor limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:09:41.184058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Image limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:09:41.184642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Flavor pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:09:41.185049 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Image pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:09:41.185480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:09:41.194279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:41.194740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:41.195522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:41.195946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:41.214377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Getting quotas for project 629a7b91ffc64154a55a45415f739949. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:09:41.218265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Getting quotas for user a8658730ea2a4a06b7b4070976c6397f and project 629a7b91ffc64154a55a45415f739949. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:09:41.229530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Going to run 1 instances... {{(pid=118256) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:09:41.231767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:09:41.430539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cb248403-822f-47d1-91c2-bdf4d1e6ac03 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.728394 Jun 02 16:09:41.431574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 203/394] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:09:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:09:41.441529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7a9a7fe9-8700-43cb-935b-d69375ae19fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:41.442182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7a9a7fe9-8700-43cb-935b-d69375ae19fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:41.444083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:41.506140 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7a9a7fe9-8700-43cb-935b-d69375ae19fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:41.514788 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7a9a7fe9-8700-43cb-935b-d69375ae19fe tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1245 microversion: 2.1 time: 0.077588 Jun 02 16:09:41.515365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 192/395] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:41 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:09:42.532695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fa201332-fae2-4877-b5cc-446686683024 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:42.533300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fa201332-fae2-4877-b5cc-446686683024 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:42.539406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa201332-fae2-4877-b5cc-446686683024 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:42.539858 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa201332-fae2-4877-b5cc-446686683024 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:42.541527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa201332-fae2-4877-b5cc-446686683024 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:42.541969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa201332-fae2-4877-b5cc-446686683024 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:42.602880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fa201332-fae2-4877-b5cc-446686683024 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:42.611025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fa201332-fae2-4877-b5cc-446686683024 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1249 microversion: 2.1 time: 0.082303 Jun 02 16:09:42.611589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 204/396] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:42 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:43.628268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9d80a766-7d70-4a03-bc7a-b049dd7bfa07 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:43.628876 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9d80a766-7d70-4a03-bc7a-b049dd7bfa07 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:43.635663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d80a766-7d70-4a03-bc7a-b049dd7bfa07 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:43.636112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d80a766-7d70-4a03-bc7a-b049dd7bfa07 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:43.636874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d80a766-7d70-4a03-bc7a-b049dd7bfa07 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:43.637309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d80a766-7d70-4a03-bc7a-b049dd7bfa07 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:43.698437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9d80a766-7d70-4a03-bc7a-b049dd7bfa07 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:43.705906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9d80a766-7d70-4a03-bc7a-b049dd7bfa07 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1297 microversion: 2.1 time: 0.081978 Jun 02 16:09:43.706506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 193/397] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:43 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:44.730501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e06388a1-282c-4ba6-b55c-f6f5009bef5b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:44.731134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e06388a1-282c-4ba6-b55c-f6f5009bef5b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:44.737207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e06388a1-282c-4ba6-b55c-f6f5009bef5b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:44.737850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e06388a1-282c-4ba6-b55c-f6f5009bef5b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:44.738522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e06388a1-282c-4ba6-b55c-f6f5009bef5b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:44.738955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e06388a1-282c-4ba6-b55c-f6f5009bef5b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:44.805966 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e06388a1-282c-4ba6-b55c-f6f5009bef5b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:44.809356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e06388a1-282c-4ba6-b55c-f6f5009bef5b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1297 microversion: 2.1 time: 0.082645 Jun 02 16:09:44.809919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 205/398] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:44 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:45.832092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-544e7e9a-d9e7-4bb5-ac80-72a2879a38bb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:45.832634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-544e7e9a-d9e7-4bb5-ac80-72a2879a38bb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:45.840140 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-544e7e9a-d9e7-4bb5-ac80-72a2879a38bb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:45.840587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-544e7e9a-d9e7-4bb5-ac80-72a2879a38bb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:45.841349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-544e7e9a-d9e7-4bb5-ac80-72a2879a38bb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:45.841790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-544e7e9a-d9e7-4bb5-ac80-72a2879a38bb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:45.904629 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-544e7e9a-d9e7-4bb5-ac80-72a2879a38bb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:45.911949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-544e7e9a-d9e7-4bb5-ac80-72a2879a38bb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1297 microversion: 2.1 time: 0.084150 Jun 02 16:09:45.912510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 194/399] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:45 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:46.928521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fa560e5b-1f0f-47ab-8f17-79f28dbffd4c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:46.929137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fa560e5b-1f0f-47ab-8f17-79f28dbffd4c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:46.935639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa560e5b-1f0f-47ab-8f17-79f28dbffd4c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:46.938381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa560e5b-1f0f-47ab-8f17-79f28dbffd4c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:46.938381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa560e5b-1f0f-47ab-8f17-79f28dbffd4c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:46.938381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa560e5b-1f0f-47ab-8f17-79f28dbffd4c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:46.998309 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fa560e5b-1f0f-47ab-8f17-79f28dbffd4c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:47.005615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fa560e5b-1f0f-47ab-8f17-79f28dbffd4c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1297 microversion: 2.1 time: 0.080890 Jun 02 16:09:47.006185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 206/400] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:46 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:48.022542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-aece324d-e87f-495c-97bb-062963de6212 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:48.023159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-aece324d-e87f-495c-97bb-062963de6212 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:48.025262 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:48.030750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aece324d-e87f-495c-97bb-062963de6212 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:48.030750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aece324d-e87f-495c-97bb-062963de6212 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:48.031509 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aece324d-e87f-495c-97bb-062963de6212 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:48.032056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aece324d-e87f-495c-97bb-062963de6212 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:48.094339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-aece324d-e87f-495c-97bb-062963de6212 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:48.101760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-aece324d-e87f-495c-97bb-062963de6212 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1305 microversion: 2.1 time: 0.083164 Jun 02 16:09:48.102365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 195/401] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:48 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1305 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:49.118991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fbfd91ce-74ed-48bf-a6a6-22cf654e7753 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:49.120386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fbfd91ce-74ed-48bf-a6a6-22cf654e7753 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:49.126903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fbfd91ce-74ed-48bf-a6a6-22cf654e7753 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:49.127351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fbfd91ce-74ed-48bf-a6a6-22cf654e7753 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:49.128131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fbfd91ce-74ed-48bf-a6a6-22cf654e7753 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:49.128564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fbfd91ce-74ed-48bf-a6a6-22cf654e7753 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:49.325050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fbfd91ce-74ed-48bf-a6a6-22cf654e7753 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:49.333184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fbfd91ce-74ed-48bf-a6a6-22cf654e7753 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1315 microversion: 2.1 time: 0.217973 Jun 02 16:09:49.333991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 207/402] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:49 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:50.285911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b6b3686b-62fb-406a-9976-2a265d68f997 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05008caa-d111-4aa0-b820-cc0a057fe407"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:09:50.286941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b6b3686b-62fb-406a-9976-2a265d68f997 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:50.294707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6b3686b-62fb-406a-9976-2a265d68f997 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:50.295168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6b3686b-62fb-406a-9976-2a265d68f997 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:50.295929 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6b3686b-62fb-406a-9976-2a265d68f997 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:50.296364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6b3686b-62fb-406a-9976-2a265d68f997 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:50.355819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-da562045-db2a-4032-9337-b783efb0d557 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:50.357878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-da562045-db2a-4032-9337-b783efb0d557 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:50.374543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da562045-db2a-4032-9337-b783efb0d557 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:50.375930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da562045-db2a-4032-9337-b783efb0d557 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:50.376885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da562045-db2a-4032-9337-b783efb0d557 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:50.377554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da562045-db2a-4032-9337-b783efb0d557 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:50.589327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-da562045-db2a-4032-9337-b783efb0d557 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:50.597156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-da562045-db2a-4032-9337-b783efb0d557 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.248207 Jun 02 16:09:50.597723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 208/403] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:50 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:51.082943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-c1da4ea2-83f7-4cd0-811f-601aa8ce6ea7 req-c481b829-94e6-4686-9c1e-1b6f2653f122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef", "tag": "3c38464f-673f-4bd1-9857-db6554c37dd9"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:09:51.094614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-c1da4ea2-83f7-4cd0-811f-601aa8ce6ea7 req-c481b829-94e6-4686-9c1e-1b6f2653f122 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:51.095048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-c1da4ea2-83f7-4cd0-811f-601aa8ce6ea7 req-c481b829-94e6-4686-9c1e-1b6f2653f122 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:51.111834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-c1da4ea2-83f7-4cd0-811f-601aa8ce6ea7 req-c481b829-94e6-4686-9c1e-1b6f2653f122 service nova] Creating event network-changed:3c38464f-673f-4bd1-9857-db6554c37dd9 for instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef on hv-cinder-79760 Jun 02 16:09:51.117528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-c1da4ea2-83f7-4cd0-811f-601aa8ce6ea7 req-c481b829-94e6-4686-9c1e-1b6f2653f122 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038588 Jun 02 16:09:51.132595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 209/404] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:09:51.309071 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b6b3686b-62fb-406a-9976-2a265d68f997 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "POST /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025782 Jun 02 16:09:51.310022 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 196/405] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:09:50 2022] POST /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments => generated 194 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:09:51.611911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:51.612625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=6 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:51.616858 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8646436d-cd5c-4aa2-8c79-b909b279d575 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:51.617561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8646436d-cd5c-4aa2-8c79-b909b279d575 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:51.624613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8646436d-cd5c-4aa2-8c79-b909b279d575 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:51.625064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8646436d-cd5c-4aa2-8c79-b909b279d575 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:51.625874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8646436d-cd5c-4aa2-8c79-b909b279d575 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:51.626334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8646436d-cd5c-4aa2-8c79-b909b279d575 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:51.642096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:51.802304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8646436d-cd5c-4aa2-8c79-b909b279d575 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:51.810265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8646436d-cd5c-4aa2-8c79-b909b279d575 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.199273 Jun 02 16:09:51.810774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 210/406] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:51 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:52.827886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-850d7cb9-662b-416f-80d4-4cc5c1cda511 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:52.828642 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-850d7cb9-662b-416f-80d4-4cc5c1cda511 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:52.830571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=6 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:52.835933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-850d7cb9-662b-416f-80d4-4cc5c1cda511 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:52.836382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-850d7cb9-662b-416f-80d4-4cc5c1cda511 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:52.837170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-850d7cb9-662b-416f-80d4-4cc5c1cda511 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:52.837880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-850d7cb9-662b-416f-80d4-4cc5c1cda511 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:52.978052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-850d7cb9-662b-416f-80d4-4cc5c1cda511 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:52.986078 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-850d7cb9-662b-416f-80d4-4cc5c1cda511 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.162429 Jun 02 16:09:52.986681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 197/407] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:52 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:54.002984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b7e62e45-9673-4a6f-b4ab-17845bf0f579 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:54.003593 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b7e62e45-9673-4a6f-b4ab-17845bf0f579 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:54.010232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b7e62e45-9673-4a6f-b4ab-17845bf0f579 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:54.010704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b7e62e45-9673-4a6f-b4ab-17845bf0f579 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:54.011469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b7e62e45-9673-4a6f-b4ab-17845bf0f579 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:54.011902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b7e62e45-9673-4a6f-b4ab-17845bf0f579 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:54.139790 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b7e62e45-9673-4a6f-b4ab-17845bf0f579 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:54.147172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b7e62e45-9673-4a6f-b4ab-17845bf0f579 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.148077 Jun 02 16:09:54.147728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 211/408] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:53 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:55.164547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-be9bc8fb-b333-48e2-af10-7bc13aa12858 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:55.165089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-be9bc8fb-b333-48e2-af10-7bc13aa12858 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:55.172939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be9bc8fb-b333-48e2-af10-7bc13aa12858 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:55.173428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be9bc8fb-b333-48e2-af10-7bc13aa12858 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:55.174679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be9bc8fb-b333-48e2-af10-7bc13aa12858 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:55.174679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be9bc8fb-b333-48e2-af10-7bc13aa12858 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:55.320053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-be9bc8fb-b333-48e2-af10-7bc13aa12858 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:55.327547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-be9bc8fb-b333-48e2-af10-7bc13aa12858 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.167047 Jun 02 16:09:55.328180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 198/409] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:55 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:56.345616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0b97ec4f-3d76-4419-a5da-c76f6f63cf76 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:56.346267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0b97ec4f-3d76-4419-a5da-c76f6f63cf76 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:56.358667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b97ec4f-3d76-4419-a5da-c76f6f63cf76 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:56.358667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b97ec4f-3d76-4419-a5da-c76f6f63cf76 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:56.358667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b97ec4f-3d76-4419-a5da-c76f6f63cf76 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:56.358667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b97ec4f-3d76-4419-a5da-c76f6f63cf76 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:56.497255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0b97ec4f-3d76-4419-a5da-c76f6f63cf76 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:56.504756 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0b97ec4f-3d76-4419-a5da-c76f6f63cf76 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.163235 Jun 02 16:09:56.505784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 212/410] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:56 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:57.523092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d73fd911-b382-4e71-a099-fd065c781dc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:57.524468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d73fd911-b382-4e71-a099-fd065c781dc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:57.531117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d73fd911-b382-4e71-a099-fd065c781dc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:57.531618 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d73fd911-b382-4e71-a099-fd065c781dc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:57.532380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d73fd911-b382-4e71-a099-fd065c781dc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:57.532811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d73fd911-b382-4e71-a099-fd065c781dc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:57.701551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d73fd911-b382-4e71-a099-fd065c781dc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:57.709989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d73fd911-b382-4e71-a099-fd065c781dc4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.190811 Jun 02 16:09:57.720081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 199/411] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:57 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:09:58.727980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-50cd9941-021f-4e8b-9414-4f91d64cd935 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:58.728508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-50cd9941-021f-4e8b-9414-4f91d64cd935 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:58.735806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50cd9941-021f-4e8b-9414-4f91d64cd935 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:58.736376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50cd9941-021f-4e8b-9414-4f91d64cd935 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:58.737339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50cd9941-021f-4e8b-9414-4f91d64cd935 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:58.737779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50cd9941-021f-4e8b-9414-4f91d64cd935 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:58.894708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-50cd9941-021f-4e8b-9414-4f91d64cd935 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:09:58.904597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-50cd9941-021f-4e8b-9414-4f91d64cd935 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.180686 Jun 02 16:09:58.905340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 213/412] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:58 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:09:59.921126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fe9dc154-c321-4df5-a43d-2d16c2d7cf00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:09:59.921734 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fe9dc154-c321-4df5-a43d-2d16c2d7cf00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:09:59.928178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe9dc154-c321-4df5-a43d-2d16c2d7cf00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:59.928637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe9dc154-c321-4df5-a43d-2d16c2d7cf00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:09:59.929516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe9dc154-c321-4df5-a43d-2d16c2d7cf00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:09:59.929952 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe9dc154-c321-4df5-a43d-2d16c2d7cf00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:00.140973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fe9dc154-c321-4df5-a43d-2d16c2d7cf00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:00.152813 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fe9dc154-c321-4df5-a43d-2d16c2d7cf00 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.233622 Jun 02 16:10:00.154142 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 200/413] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:09:59 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:01.175297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-97d494fb-41ce-422c-877a-f787091f1410 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:01.175906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-97d494fb-41ce-422c-877a-f787091f1410 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:01.181950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-97d494fb-41ce-422c-877a-f787091f1410 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:01.187154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-97d494fb-41ce-422c-877a-f787091f1410 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:01.187154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-97d494fb-41ce-422c-877a-f787091f1410 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:01.187154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-97d494fb-41ce-422c-877a-f787091f1410 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:01.384612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-97d494fb-41ce-422c-877a-f787091f1410 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:01.398183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-97d494fb-41ce-422c-877a-f787091f1410 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.226632 Jun 02 16:10:01.398771 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 214/414] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:01 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:02.416495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e326261e-7a49-4b8d-840b-17ad56c0070e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:02.417391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e326261e-7a49-4b8d-840b-17ad56c0070e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:02.438860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e326261e-7a49-4b8d-840b-17ad56c0070e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:02.438860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e326261e-7a49-4b8d-840b-17ad56c0070e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:02.439374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e326261e-7a49-4b8d-840b-17ad56c0070e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:02.439815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e326261e-7a49-4b8d-840b-17ad56c0070e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:02.477572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:02.611099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e326261e-7a49-4b8d-840b-17ad56c0070e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:02.619400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e326261e-7a49-4b8d-840b-17ad56c0070e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.207348 Jun 02 16:10:02.621361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 201/415] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:02 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:03.518600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3b4d40c6-d4b8-4930-8f38-9a5f8f6ce3cd tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:03.519142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3b4d40c6-d4b8-4930-8f38-9a5f8f6ce3cd tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:03.525727 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b4d40c6-d4b8-4930-8f38-9a5f8f6ce3cd tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:03.526506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b4d40c6-d4b8-4930-8f38-9a5f8f6ce3cd tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:03.527828 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b4d40c6-d4b8-4930-8f38-9a5f8f6ce3cd tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:03.528429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b4d40c6-d4b8-4930-8f38-9a5f8f6ce3cd tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:03.653690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-33542907-b3b4-4938-bb68-5e4a8f88fd6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:03.654475 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-33542907-b3b4-4938-bb68-5e4a8f88fd6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:03.663388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33542907-b3b4-4938-bb68-5e4a8f88fd6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:03.663948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33542907-b3b4-4938-bb68-5e4a8f88fd6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:03.664827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33542907-b3b4-4938-bb68-5e4a8f88fd6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:03.665273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33542907-b3b4-4938-bb68-5e4a8f88fd6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:03.696704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3b4d40c6-d4b8-4930-8f38-9a5f8f6ce3cd tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:03.712940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3b4d40c6-d4b8-4930-8f38-9a5f8f6ce3cd tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1594 microversion: 2.1 time: 0.198105 Jun 02 16:10:03.713541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 215/416] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:03 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1594 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:03.774927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1354669160", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "networks": [{"uuid": "3760d56b-dc2b-4667-8533-d72e68f76d1b"}]}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:03.869624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.network.neutron [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] validate_networks() for [('3760d56b-dc2b-4667-8533-d72e68f76d1b', None, None, None, None, None)] {{(pid=118256) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:10:03.972648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-33542907-b3b4-4938-bb68-5e4a8f88fd6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:03.982371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-33542907-b3b4-4938-bb68-5e4a8f88fd6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.348384 Jun 02 16:10:03.986840 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 202/417] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:03 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:03.997852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-90fe6ddd-e3b5-48f2-83bc-a0bbf216bb21 req-0bbb23a0-9332-4df1-a7c6-1baa4b48a345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef", "name": "network-vif-plugged", "status": "completed", "tag": "3c38464f-673f-4bd1-9857-db6554c37dd9"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:04.008153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-90fe6ddd-e3b5-48f2-83bc-a0bbf216bb21 req-0bbb23a0-9332-4df1-a7c6-1baa4b48a345 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:04.008716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-90fe6ddd-e3b5-48f2-83bc-a0bbf216bb21 req-0bbb23a0-9332-4df1-a7c6-1baa4b48a345 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:04.025732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-90fe6ddd-e3b5-48f2-83bc-a0bbf216bb21 req-0bbb23a0-9332-4df1-a7c6-1baa4b48a345 service nova] Creating event network-vif-plugged:3c38464f-673f-4bd1-9857-db6554c37dd9 for instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef on hv-cinder-79760 Jun 02 16:10:04.033279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-90fe6ddd-e3b5-48f2-83bc-a0bbf216bb21 req-0bbb23a0-9332-4df1-a7c6-1baa4b48a345 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044281 Jun 02 16:10:04.033511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 203/418] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:04.585152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Flavor limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:10:04.585636 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Image limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:10:04.586041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Flavor pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:10:04.587363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Image pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:10:04.587787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:10:04.603882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:04.603882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:04.603882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:04.603882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:04.653169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Getting quotas for project b42e4a202a4942818fd25d0f25abe9de. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:10:04.653169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Getting quotas for user e1dbb393020e452fb78d212cf60a2a72 and project b42e4a202a4942818fd25d0f25abe9de. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:10:04.660244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Going to run 1 instances... {{(pid=118256) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:10:04.663268 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:10:04.828875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f2692e81-e59a-4852-8b9b-97fbb876559e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058202 Jun 02 16:10:04.830337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 216/419] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:10:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 16:10:04.841562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ccf3bd8f-88c0-48b9-867e-145821d539ee tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:04.842893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ccf3bd8f-88c0-48b9-867e-145821d539ee tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:05.004508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-92a47558-2f3d-4a25-b081-399f1531a04c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:05.005758 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-92a47558-2f3d-4a25-b081-399f1531a04c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:05.019790 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-92a47558-2f3d-4a25-b081-399f1531a04c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:05.020530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-92a47558-2f3d-4a25-b081-399f1531a04c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:05.021503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-92a47558-2f3d-4a25-b081-399f1531a04c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:05.022376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-92a47558-2f3d-4a25-b081-399f1531a04c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:05.030401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ccf3bd8f-88c0-48b9-867e-145821d539ee tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:05.045100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ccf3bd8f-88c0-48b9-867e-145821d539ee tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1214 microversion: 2.1 time: 0.203533 Jun 02 16:10:05.045100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 204/420] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:04 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:05.261844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-92a47558-2f3d-4a25-b081-399f1531a04c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:05.269627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-92a47558-2f3d-4a25-b081-399f1531a04c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.269833 Jun 02 16:10:05.270234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 217/421] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:04 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:06.058690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1be20b27-36e5-4c7c-92d2-537cbc00ab38 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:06.071912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1be20b27-36e5-4c7c-92d2-537cbc00ab38 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:06.176746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1be20b27-36e5-4c7c-92d2-537cbc00ab38 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:06.187661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1be20b27-36e5-4c7c-92d2-537cbc00ab38 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1214 microversion: 2.1 time: 0.134503 Jun 02 16:10:06.188958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 205/422] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:06 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:06.286955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-26eddd55-643f-44d9-b0d0-55ca68da3ade tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:06.288322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-26eddd55-643f-44d9-b0d0-55ca68da3ade tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:06.291614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:06.302713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-26eddd55-643f-44d9-b0d0-55ca68da3ade tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:06.303166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-26eddd55-643f-44d9-b0d0-55ca68da3ade tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:06.303957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-26eddd55-643f-44d9-b0d0-55ca68da3ade tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:06.304392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-26eddd55-643f-44d9-b0d0-55ca68da3ade tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:06.555962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-26eddd55-643f-44d9-b0d0-55ca68da3ade tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:06.565796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-26eddd55-643f-44d9-b0d0-55ca68da3ade tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.282853 Jun 02 16:10:06.566563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 218/423] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:06 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:07.173113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-e31bf674-58ff-461e-a928-c3e9ff2fbdcc req-ddbf2d42-1317-449b-b0e8-56da114aaf8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4649971-cb55-4c10-83c7-e0831c1d9a2b", "tag": "f1a43f7e-70f3-4a67-af40-e30955976d64"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:07.197356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e31bf674-58ff-461e-a928-c3e9ff2fbdcc req-ddbf2d42-1317-449b-b0e8-56da114aaf8a service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:07.197870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e31bf674-58ff-461e-a928-c3e9ff2fbdcc req-ddbf2d42-1317-449b-b0e8-56da114aaf8a service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:07.205397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b5ac1cc3-06dd-49f8-adf3-69d0c3d12bb7 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:07.206014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b5ac1cc3-06dd-49f8-adf3-69d0c3d12bb7 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:07.213435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b5ac1cc3-06dd-49f8-adf3-69d0c3d12bb7 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:07.214050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b5ac1cc3-06dd-49f8-adf3-69d0c3d12bb7 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:07.215639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b5ac1cc3-06dd-49f8-adf3-69d0c3d12bb7 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:07.216077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b5ac1cc3-06dd-49f8-adf3-69d0c3d12bb7 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:07.222553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-e31bf674-58ff-461e-a928-c3e9ff2fbdcc req-ddbf2d42-1317-449b-b0e8-56da114aaf8a service nova] Creating event network-changed:f1a43f7e-70f3-4a67-af40-e30955976d64 for instance b4649971-cb55-4c10-83c7-e0831c1d9a2b on hv-cinder-79760 Jun 02 16:10:07.556354 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-e31bf674-58ff-461e-a928-c3e9ff2fbdcc req-ddbf2d42-1317-449b-b0e8-56da114aaf8a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064084 Jun 02 16:10:07.556354 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 206/424] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:07.558696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b5ac1cc3-06dd-49f8-adf3-69d0c3d12bb7 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:07.558696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b5ac1cc3-06dd-49f8-adf3-69d0c3d12bb7 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1210 microversion: 2.1 time: 0.178121 Jun 02 16:10:07.558696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 219/425] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:07 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1210 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:07.583943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b47427e1-8957-49a6-a796-dd1212b52765 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:07.584946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b47427e1-8957-49a6-a796-dd1212b52765 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:07.592170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b47427e1-8957-49a6-a796-dd1212b52765 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:07.592628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b47427e1-8957-49a6-a796-dd1212b52765 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:07.593617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b47427e1-8957-49a6-a796-dd1212b52765 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:07.594245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b47427e1-8957-49a6-a796-dd1212b52765 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:07.882050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b47427e1-8957-49a6-a796-dd1212b52765 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:07.896164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b47427e1-8957-49a6-a796-dd1212b52765 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1371 microversion: 2.1 time: 0.316274 Jun 02 16:10:07.897014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 207/426] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:07 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:08.399659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bd46cb8b-adba-4275-b3c4-09a83739452f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:08.400535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bd46cb8b-adba-4275-b3c4-09a83739452f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:08.413097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bd46cb8b-adba-4275-b3c4-09a83739452f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:08.418956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bd46cb8b-adba-4275-b3c4-09a83739452f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:08.420692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bd46cb8b-adba-4275-b3c4-09a83739452f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:08.423200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bd46cb8b-adba-4275-b3c4-09a83739452f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:08.582753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bd46cb8b-adba-4275-b3c4-09a83739452f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:08.591755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bd46cb8b-adba-4275-b3c4-09a83739452f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1274 microversion: 2.1 time: 0.195778 Jun 02 16:10:08.606086 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 220/427] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:08 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:08.913148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6cec99ef-29a0-4411-9525-d571d8517e3e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:08.921034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6cec99ef-29a0-4411-9525-d571d8517e3e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:08.921383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6cec99ef-29a0-4411-9525-d571d8517e3e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:08.921836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6cec99ef-29a0-4411-9525-d571d8517e3e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:08.922633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6cec99ef-29a0-4411-9525-d571d8517e3e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:08.923066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6cec99ef-29a0-4411-9525-d571d8517e3e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:09.143342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6cec99ef-29a0-4411-9525-d571d8517e3e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:09.154362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6cec99ef-29a0-4411-9525-d571d8517e3e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1565 microversion: 2.1 time: 0.245398 Jun 02 16:10:09.155775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 208/428] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:08 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1565 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:09.173074 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b02fd655-9c25-443d-beaa-cf4915f7b8c7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:09.173649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b02fd655-9c25-443d-beaa-cf4915f7b8c7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:09.180514 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b02fd655-9c25-443d-beaa-cf4915f7b8c7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:09.181240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b02fd655-9c25-443d-beaa-cf4915f7b8c7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:09.182288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b02fd655-9c25-443d-beaa-cf4915f7b8c7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:09.182969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b02fd655-9c25-443d-beaa-cf4915f7b8c7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:09.315626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b02fd655-9c25-443d-beaa-cf4915f7b8c7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147311 Jun 02 16:10:09.319361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 221/429] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 2 16:10:09 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:09.613513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-73738962-fd7d-4983-8b9d-d3dac3a8705a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:09.614700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-73738962-fd7d-4983-8b9d-d3dac3a8705a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:09.624087 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-73738962-fd7d-4983-8b9d-d3dac3a8705a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:09.624893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-73738962-fd7d-4983-8b9d-d3dac3a8705a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:09.632651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-73738962-fd7d-4983-8b9d-d3dac3a8705a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:09.633493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-73738962-fd7d-4983-8b9d-d3dac3a8705a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:09.879563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-73738962-fd7d-4983-8b9d-d3dac3a8705a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:09.895103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-73738962-fd7d-4983-8b9d-d3dac3a8705a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.282787 Jun 02 16:10:09.896116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 209/430] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:09 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:10.913347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b6a46059-557d-4471-83da-bd9563eb13b5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:10.913975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b6a46059-557d-4471-83da-bd9563eb13b5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:10.921138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b6a46059-557d-4471-83da-bd9563eb13b5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:10.922610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b6a46059-557d-4471-83da-bd9563eb13b5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:10.923501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b6a46059-557d-4471-83da-bd9563eb13b5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:10.924180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b6a46059-557d-4471-83da-bd9563eb13b5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:11.000590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-f598eca5-ee11-405a-91f4-2355c021aa94 req-c382caad-7fa5-46da-96e1-ae03c1b0cb5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8f7801-8144-4b99-95a2-d093dd5479a0", "tag": "0003edb1-d8a7-4a0e-aac4-bb3212156564"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:11.018106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-f598eca5-ee11-405a-91f4-2355c021aa94 req-c382caad-7fa5-46da-96e1-ae03c1b0cb5d service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:11.018553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-f598eca5-ee11-405a-91f4-2355c021aa94 req-c382caad-7fa5-46da-96e1-ae03c1b0cb5d service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:11.046144 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-f598eca5-ee11-405a-91f4-2355c021aa94 req-c382caad-7fa5-46da-96e1-ae03c1b0cb5d service nova] Creating event network-changed:0003edb1-d8a7-4a0e-aac4-bb3212156564 for instance 9b8f7801-8144-4b99-95a2-d093dd5479a0 on hv-cinder-79760 Jun 02 16:10:11.052944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-f598eca5-ee11-405a-91f4-2355c021aa94 req-c382caad-7fa5-46da-96e1-ae03c1b0cb5d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055813 Jun 02 16:10:11.061247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 210/431] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:10:11.304811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b6a46059-557d-4471-83da-bd9563eb13b5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:11.311313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b6a46059-557d-4471-83da-bd9563eb13b5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.402302 Jun 02 16:10:11.312550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 222/432] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:10 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:11.820129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-175d3b7c-2efd-49bd-a2f3-908b933ad473 req-3c8383ea-2c1f-4b48-af40-7a6de83e11ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef", "tag": "3c38464f-673f-4bd1-9857-db6554c37dd9"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:11.830734 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-175d3b7c-2efd-49bd-a2f3-908b933ad473 req-3c8383ea-2c1f-4b48-af40-7a6de83e11ea service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:11.831306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-175d3b7c-2efd-49bd-a2f3-908b933ad473 req-3c8383ea-2c1f-4b48-af40-7a6de83e11ea service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:11.844141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-175d3b7c-2efd-49bd-a2f3-908b933ad473 req-3c8383ea-2c1f-4b48-af40-7a6de83e11ea service nova] Creating event network-changed:3c38464f-673f-4bd1-9857-db6554c37dd9 for instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef on hv-cinder-79760 Jun 02 16:10:11.849906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-175d3b7c-2efd-49bd-a2f3-908b933ad473 req-3c8383ea-2c1f-4b48-af40-7a6de83e11ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033547 Jun 02 16:10:11.853415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 211/433] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:12.289604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ce0b0a39-17c7-4b03-b8e1-b9ac36286c78 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1332151741"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:12.292349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ce0b0a39-17c7-4b03-b8e1-b9ac36286c78 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:12.301064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce0b0a39-17c7-4b03-b8e1-b9ac36286c78 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:12.302410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce0b0a39-17c7-4b03-b8e1-b9ac36286c78 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:12.303902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce0b0a39-17c7-4b03-b8e1-b9ac36286c78 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:12.304708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce0b0a39-17c7-4b03-b8e1-b9ac36286c78 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:12.329757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-52300bdd-df6b-4fbb-8997-e2a9c7132e75 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:12.331404 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-52300bdd-df6b-4fbb-8997-e2a9c7132e75 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:12.346431 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52300bdd-df6b-4fbb-8997-e2a9c7132e75 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:12.347295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52300bdd-df6b-4fbb-8997-e2a9c7132e75 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:12.353847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52300bdd-df6b-4fbb-8997-e2a9c7132e75 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:12.353847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52300bdd-df6b-4fbb-8997-e2a9c7132e75 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:12.524056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-52300bdd-df6b-4fbb-8997-e2a9c7132e75 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:12.535848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-52300bdd-df6b-4fbb-8997-e2a9c7132e75 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.210268 Jun 02 16:10:12.537176 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 212/434] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:12 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:12.794778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.network.security_group_api [None req-ce0b0a39-17c7-4b03-b8e1-b9ac36286c78 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Adding security group 38f8ebdf-4ca6-4cea-b87f-a39a338e16c3 to port f1a43f7e-70f3-4a67-af40-e30955976d64 Jun 02 16:10:13.555173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a418feab-39fe-4c58-b631-b40e189b8865 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:13.555173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a418feab-39fe-4c58-b631-b40e189b8865 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:13.563061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a418feab-39fe-4c58-b631-b40e189b8865 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:13.563586 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a418feab-39fe-4c58-b631-b40e189b8865 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:13.564422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a418feab-39fe-4c58-b631-b40e189b8865 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:13.564923 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a418feab-39fe-4c58-b631-b40e189b8865 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:13.591215 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ce0b0a39-17c7-4b03-b8e1-b9ac36286c78 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "POST /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/action" status: 202 len: 0 microversion: 2.1 time: 1.305491 Jun 02 16:10:13.594555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 223/435] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:10:12 2022] POST /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/action => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:10:13.603207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ce31c622-acb4-4d6c-bec8-dcbedc4cccbb tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:13.604109 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ce31c622-acb4-4d6c-bec8-dcbedc4cccbb tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:13.612030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce31c622-acb4-4d6c-bec8-dcbedc4cccbb tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:13.612634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce31c622-acb4-4d6c-bec8-dcbedc4cccbb tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:13.613638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce31c622-acb4-4d6c-bec8-dcbedc4cccbb tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:13.614317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce31c622-acb4-4d6c-bec8-dcbedc4cccbb tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:13.762758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a418feab-39fe-4c58-b631-b40e189b8865 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:13.774986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a418feab-39fe-4c58-b631-b40e189b8865 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.224474 Jun 02 16:10:13.783119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 213/436] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:13 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:13.864238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-f9afddf9-cd07-49a7-a4df-eb7a99257401 req-257d4e69-bf5f-48b4-adf3-c9d909538569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4649971-cb55-4c10-83c7-e0831c1d9a2b", "tag": "f1a43f7e-70f3-4a67-af40-e30955976d64"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:13.869347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=50 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:13.873481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-f9afddf9-cd07-49a7-a4df-eb7a99257401 req-257d4e69-bf5f-48b4-adf3-c9d909538569 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:13.874053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-f9afddf9-cd07-49a7-a4df-eb7a99257401 req-257d4e69-bf5f-48b4-adf3-c9d909538569 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:13.888019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-f9afddf9-cd07-49a7-a4df-eb7a99257401 req-257d4e69-bf5f-48b4-adf3-c9d909538569 service nova] Creating event network-changed:f1a43f7e-70f3-4a67-af40-e30955976d64 for instance b4649971-cb55-4c10-83c7-e0831c1d9a2b on hv-cinder-79760 Jun 02 16:10:13.889203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ce31c622-acb4-4d6c-bec8-dcbedc4cccbb tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:13.895676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-f9afddf9-cd07-49a7-a4df-eb7a99257401 req-257d4e69-bf5f-48b4-adf3-c9d909538569 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034262 Jun 02 16:10:13.914533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 214/437] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:10:13.915188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ce31c622-acb4-4d6c-bec8-dcbedc4cccbb tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1760 microversion: 2.1 time: 0.302187 Jun 02 16:10:13.915188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 224/438] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:13 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1760 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:14.794225 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3892be52-4323-4a04-bee8-648fab810de6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:14.795056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3892be52-4323-4a04-bee8-648fab810de6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:14.806046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3892be52-4323-4a04-bee8-648fab810de6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:14.806654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3892be52-4323-4a04-bee8-648fab810de6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:14.807513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3892be52-4323-4a04-bee8-648fab810de6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:14.807947 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3892be52-4323-4a04-bee8-648fab810de6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:14.847588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1036327540", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:14.864526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:14.865390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=6 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:14.916117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.network.neutron [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] validate_networks() for None {{(pid=118256) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:10:15.066553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3892be52-4323-4a04-bee8-648fab810de6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:15.080186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3892be52-4323-4a04-bee8-648fab810de6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.290719 Jun 02 16:10:15.080960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 215/439] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:14 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:15.206787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Flavor limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:10:15.207206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Image limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:10:15.207665 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Flavor pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:10:15.208388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Image pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:10:15.208796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:10:15.218606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:15.219048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:15.219836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:15.220262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:15.238066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Getting quotas for project 0c053fa2e3254a849acdb5116ec9644b. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:10:15.247414 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Getting quotas for user c622005135854b0c9984f5851b300e8e and project 0c053fa2e3254a849acdb5116ec9644b. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:10:15.259800 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Going to run 1 instances... {{(pid=118256) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:10:15.263305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:10:15.464030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c4186238-71b8-4b77-915e-1e6461073c58 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620420 Jun 02 16:10:15.465606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 225/440] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:10:15.479964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5d1b8769-5908-4372-a022-638860813dff tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:15.480767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5d1b8769-5908-4372-a022-638860813dff tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:15.616014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5d1b8769-5908-4372-a022-638860813dff tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:15.626227 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5d1b8769-5908-4372-a022-638860813dff tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1215 microversion: 2.1 time: 0.154200 Jun 02 16:10:15.628771 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 216/441] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:15 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:16.098874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-898c829c-e33c-4e36-910d-0cca6f8b642c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:16.099566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-898c829c-e33c-4e36-910d-0cca6f8b642c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:16.116199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-898c829c-e33c-4e36-910d-0cca6f8b642c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:16.116775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-898c829c-e33c-4e36-910d-0cca6f8b642c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:16.117631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-898c829c-e33c-4e36-910d-0cca6f8b642c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:16.118202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-898c829c-e33c-4e36-910d-0cca6f8b642c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:16.309600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-898c829c-e33c-4e36-910d-0cca6f8b642c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:16.324246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-898c829c-e33c-4e36-910d-0cca6f8b642c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.229792 Jun 02 16:10:16.325675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 226/442] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:16 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:16.645155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-955785f7-c5d5-4c4e-910f-a9abd1ea74d0 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:16.645915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-955785f7-c5d5-4c4e-910f-a9abd1ea74d0 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:16.719698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-955785f7-c5d5-4c4e-910f-a9abd1ea74d0 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:16.722285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-955785f7-c5d5-4c4e-910f-a9abd1ea74d0 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1215 microversion: 2.1 time: 0.081078 Jun 02 16:10:16.722856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 217/443] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:16 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:17.046320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9ff5ed7b-3e60-4e78-807b-414263aaf3a7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Action: 'create', calling method: .version_select at 0x7f2d5c7399d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2029801029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHxRVRTYbA2HjtW6DtkLGYz1lj8iM+7TCUaZjeGufPt+LV5t4t5NPsMV7bM0k0DAKxGk+0ol0qGeQfLjScqklD2fYiDFV1cXNp6YTs4sBg2zAZBL4dGFdtOWMWHdJutSg=="}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:17.061941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-9ff5ed7b-3e60-4e78-807b-414263aaf3a7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Getting quotas for project aa7bcb5f489f4a2db902c2035d9879a5. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:10:17.066240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-9ff5ed7b-3e60-4e78-807b-414263aaf3a7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Getting quotas for user 2f09d7a733fa43a7a45f56176c752447 and project aa7bcb5f489f4a2db902c2035d9879a5. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:10:17.204398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9ff5ed7b-3e60-4e78-807b-414263aaf3a7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.331927 Jun 02 16:10:17.205033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 227/444] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 2 16:10:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:17.342025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-674a0332-9ba9-49db-96d6-483826663b02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:17.342779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-674a0332-9ba9-49db-96d6-483826663b02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:17.349508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-674a0332-9ba9-49db-96d6-483826663b02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:17.350247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-674a0332-9ba9-49db-96d6-483826663b02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:17.351016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-674a0332-9ba9-49db-96d6-483826663b02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:17.351453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-674a0332-9ba9-49db-96d6-483826663b02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:17.500348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-674a0332-9ba9-49db-96d6-483826663b02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:17.508416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-674a0332-9ba9-49db-96d6-483826663b02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.170477 Jun 02 16:10:17.508977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 218/445] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:17 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:17.741564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d4e1b3ac-8a42-4547-be8b-46a5a6283bf7 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:17.750314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d4e1b3ac-8a42-4547-be8b-46a5a6283bf7 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:17.757115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d4e1b3ac-8a42-4547-be8b-46a5a6283bf7 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:17.758179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d4e1b3ac-8a42-4547-be8b-46a5a6283bf7 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:17.759423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d4e1b3ac-8a42-4547-be8b-46a5a6283bf7 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:17.760055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d4e1b3ac-8a42-4547-be8b-46a5a6283bf7 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:17.834851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d4e1b3ac-8a42-4547-be8b-46a5a6283bf7 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:17.843263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d4e1b3ac-8a42-4547-be8b-46a5a6283bf7 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1267 microversion: 2.1 time: 0.105727 Jun 02 16:10:17.843840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 228/446] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:17 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:18.527334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7499ddc7-7b0b-4218-85e9-3a1f503fc9e9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:18.543916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7499ddc7-7b0b-4218-85e9-3a1f503fc9e9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:18.543916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7499ddc7-7b0b-4218-85e9-3a1f503fc9e9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:18.543916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7499ddc7-7b0b-4218-85e9-3a1f503fc9e9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:18.543916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7499ddc7-7b0b-4218-85e9-3a1f503fc9e9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:18.544361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7499ddc7-7b0b-4218-85e9-3a1f503fc9e9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:18.833223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7499ddc7-7b0b-4218-85e9-3a1f503fc9e9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:18.841760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7499ddc7-7b0b-4218-85e9-3a1f503fc9e9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.318677 Jun 02 16:10:18.842386 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 219/447] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:18 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:18.859999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-04d23036-e19c-40d4-a422-100e64f51a56 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:18.860527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-04d23036-e19c-40d4-a422-100e64f51a56 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:18.866592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04d23036-e19c-40d4-a422-100e64f51a56 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:18.867092 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04d23036-e19c-40d4-a422-100e64f51a56 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:18.869317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04d23036-e19c-40d4-a422-100e64f51a56 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:18.869317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04d23036-e19c-40d4-a422-100e64f51a56 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:18.943032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-04d23036-e19c-40d4-a422-100e64f51a56 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:18.958905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-04d23036-e19c-40d4-a422-100e64f51a56 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1285 microversion: 2.1 time: 0.102792 Jun 02 16:10:18.959747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 229/448] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:18 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:19.859724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2e12a45f-24e1-4625-b839-65ee7a5e7b78 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:19.860399 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2e12a45f-24e1-4625-b839-65ee7a5e7b78 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:19.867170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2e12a45f-24e1-4625-b839-65ee7a5e7b78 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:19.867879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2e12a45f-24e1-4625-b839-65ee7a5e7b78 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:19.868654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2e12a45f-24e1-4625-b839-65ee7a5e7b78 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:19.869087 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2e12a45f-24e1-4625-b839-65ee7a5e7b78 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:19.981522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c3e8145b-d0c6-4466-8de2-7c6a281ebcd9 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:19.982305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c3e8145b-d0c6-4466-8de2-7c6a281ebcd9 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:19.992956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3e8145b-d0c6-4466-8de2-7c6a281ebcd9 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:19.995791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3e8145b-d0c6-4466-8de2-7c6a281ebcd9 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:19.996704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3e8145b-d0c6-4466-8de2-7c6a281ebcd9 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:20.000712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3e8145b-d0c6-4466-8de2-7c6a281ebcd9 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:20.011683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:20.112767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2e12a45f-24e1-4625-b839-65ee7a5e7b78 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:20.123120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2e12a45f-24e1-4625-b839-65ee7a5e7b78 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.267476 Jun 02 16:10:20.123717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 220/449] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:19 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:20.277476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c3e8145b-d0c6-4466-8de2-7c6a281ebcd9 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:20.291299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c3e8145b-d0c6-4466-8de2-7c6a281ebcd9 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.314197 Jun 02 16:10:20.297200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 230/450] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:19 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:21.051588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-e0aa5271-135d-4d40-a383-137b9e874d58 req-7fdfa276-45b8-4b8b-b632-4a254d6f0019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8f7801-8144-4b99-95a2-d093dd5479a0", "name": "network-vif-plugged", "status": "completed", "tag": "0003edb1-d8a7-4a0e-aac4-bb3212156564"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:21.064854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e0aa5271-135d-4d40-a383-137b9e874d58 req-7fdfa276-45b8-4b8b-b632-4a254d6f0019 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:21.065319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e0aa5271-135d-4d40-a383-137b9e874d58 req-7fdfa276-45b8-4b8b-b632-4a254d6f0019 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:21.079145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-ed4196db-6eb5-452d-8db4-ff390d426dd6 req-32f303de-80c1-4900-8074-48c89c4d9a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f134ba8b-93f9-4db0-ae59-985dcfaa5221", "tag": "8800c6b1-d740-418c-8957-3683c482c442"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:21.087465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-e0aa5271-135d-4d40-a383-137b9e874d58 req-7fdfa276-45b8-4b8b-b632-4a254d6f0019 service nova] Creating event network-vif-plugged:0003edb1-d8a7-4a0e-aac4-bb3212156564 for instance 9b8f7801-8144-4b99-95a2-d093dd5479a0 on hv-cinder-79760 Jun 02 16:10:21.100033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-ed4196db-6eb5-452d-8db4-ff390d426dd6 req-32f303de-80c1-4900-8074-48c89c4d9a60 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:21.100611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-ed4196db-6eb5-452d-8db4-ff390d426dd6 req-32f303de-80c1-4900-8074-48c89c4d9a60 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:21.112152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-e0aa5271-135d-4d40-a383-137b9e874d58 req-7fdfa276-45b8-4b8b-b632-4a254d6f0019 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064217 Jun 02 16:10:21.112771 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 221/451] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:21.123919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-ed4196db-6eb5-452d-8db4-ff390d426dd6 req-32f303de-80c1-4900-8074-48c89c4d9a60 service nova] Creating event network-changed:8800c6b1-d740-418c-8957-3683c482c442 for instance f134ba8b-93f9-4db0-ae59-985dcfaa5221 on hv-cinder-79760 Jun 02 16:10:21.128889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-ed4196db-6eb5-452d-8db4-ff390d426dd6 req-32f303de-80c1-4900-8074-48c89c4d9a60 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053495 Jun 02 16:10:21.129667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 231/452] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:10:21.146747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a06fe14a-cefb-4a6b-af1f-236d01d94e02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:21.146747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a06fe14a-cefb-4a6b-af1f-236d01d94e02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:21.150835 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a06fe14a-cefb-4a6b-af1f-236d01d94e02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:21.151800 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a06fe14a-cefb-4a6b-af1f-236d01d94e02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:21.153094 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a06fe14a-cefb-4a6b-af1f-236d01d94e02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:21.153682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a06fe14a-cefb-4a6b-af1f-236d01d94e02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:21.311929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9a7e13a5-eb03-4bb8-a274-2f6f977d28e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:21.312929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9a7e13a5-eb03-4bb8-a274-2f6f977d28e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:21.319487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a7e13a5-eb03-4bb8-a274-2f6f977d28e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:21.321711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a7e13a5-eb03-4bb8-a274-2f6f977d28e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:21.321711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a7e13a5-eb03-4bb8-a274-2f6f977d28e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:21.321711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a7e13a5-eb03-4bb8-a274-2f6f977d28e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:21.349401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a06fe14a-cefb-4a6b-af1f-236d01d94e02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:21.359313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a06fe14a-cefb-4a6b-af1f-236d01d94e02 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.220917 Jun 02 16:10:21.359902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 222/453] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:21 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:21.461382 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9a7e13a5-eb03-4bb8-a274-2f6f977d28e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:21.469654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9a7e13a5-eb03-4bb8-a274-2f6f977d28e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.163100 Jun 02 16:10:21.470557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 232/454] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:21 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:22.376517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-93543011-7635-42b0-8d51-5f0df8722c25 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:22.377064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-93543011-7635-42b0-8d51-5f0df8722c25 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:22.383604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93543011-7635-42b0-8d51-5f0df8722c25 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:22.384047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93543011-7635-42b0-8d51-5f0df8722c25 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:22.384810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93543011-7635-42b0-8d51-5f0df8722c25 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:22.385245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93543011-7635-42b0-8d51-5f0df8722c25 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:22.486362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3a026be1-9651-446a-9c65-837152585a37 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:22.487748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3a026be1-9651-446a-9c65-837152585a37 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:22.493983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a026be1-9651-446a-9c65-837152585a37 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:22.494557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a026be1-9651-446a-9c65-837152585a37 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:22.496388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a026be1-9651-446a-9c65-837152585a37 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:22.497673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a026be1-9651-446a-9c65-837152585a37 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:22.528414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-93543011-7635-42b0-8d51-5f0df8722c25 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:22.536497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-93543011-7635-42b0-8d51-5f0df8722c25 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.163732 Jun 02 16:10:22.537079 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 223/455] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:22 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:22.636394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3a026be1-9651-446a-9c65-837152585a37 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:22.643998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3a026be1-9651-446a-9c65-837152585a37 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.161623 Jun 02 16:10:22.644569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 233/456] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:22 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:23.552702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a285a7e2-7a33-441c-9562-8427f2efec9f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:23.553349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a285a7e2-7a33-441c-9562-8427f2efec9f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:23.560821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a285a7e2-7a33-441c-9562-8427f2efec9f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:23.561272 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a285a7e2-7a33-441c-9562-8427f2efec9f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:23.562036 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a285a7e2-7a33-441c-9562-8427f2efec9f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:23.562500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a285a7e2-7a33-441c-9562-8427f2efec9f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:23.662444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-695b13aa-8611-42ac-a4a6-c093e220a8e8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:23.663078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-695b13aa-8611-42ac-a4a6-c093e220a8e8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:23.670038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-695b13aa-8611-42ac-a4a6-c093e220a8e8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:23.670588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-695b13aa-8611-42ac-a4a6-c093e220a8e8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:23.671390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-695b13aa-8611-42ac-a4a6-c093e220a8e8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:23.671825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-695b13aa-8611-42ac-a4a6-c093e220a8e8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:23.699343 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a285a7e2-7a33-441c-9562-8427f2efec9f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:23.707238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a285a7e2-7a33-441c-9562-8427f2efec9f tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.158377 Jun 02 16:10:23.707912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 224/457] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:23 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:24.037867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-695b13aa-8611-42ac-a4a6-c093e220a8e8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:24.045797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-695b13aa-8611-42ac-a4a6-c093e220a8e8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.387608 Jun 02 16:10:24.046390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 234/458] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:23 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:24.724824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8e088854-c320-40d4-ba25-fe9762e351ea tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:24.725350 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8e088854-c320-40d4-ba25-fe9762e351ea tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:24.732853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e088854-c320-40d4-ba25-fe9762e351ea tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:24.733306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e088854-c320-40d4-ba25-fe9762e351ea tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:24.734144 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e088854-c320-40d4-ba25-fe9762e351ea tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:24.734581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e088854-c320-40d4-ba25-fe9762e351ea tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:24.870497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8e088854-c320-40d4-ba25-fe9762e351ea tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:24.872829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:24.878707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8e088854-c320-40d4-ba25-fe9762e351ea tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.157851 Jun 02 16:10:24.897388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 225/459] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:24 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:25.062738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9b67539f-4e01-41d1-915c-34636b91a529 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:25.063292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9b67539f-4e01-41d1-915c-34636b91a529 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:25.069353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b67539f-4e01-41d1-915c-34636b91a529 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:25.069797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b67539f-4e01-41d1-915c-34636b91a529 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:25.070579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b67539f-4e01-41d1-915c-34636b91a529 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:25.071011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b67539f-4e01-41d1-915c-34636b91a529 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:25.208172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9b67539f-4e01-41d1-915c-34636b91a529 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:25.215795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9b67539f-4e01-41d1-915c-34636b91a529 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.157017 Jun 02 16:10:25.216348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 235/460] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:25 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:25.897116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7d37f713-6b69-4dcc-b7d8-b293016adc7a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:25.898311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7d37f713-6b69-4dcc-b7d8-b293016adc7a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:25.905426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d37f713-6b69-4dcc-b7d8-b293016adc7a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:25.905884 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d37f713-6b69-4dcc-b7d8-b293016adc7a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:25.906771 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d37f713-6b69-4dcc-b7d8-b293016adc7a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:25.907212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d37f713-6b69-4dcc-b7d8-b293016adc7a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:26.043595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7d37f713-6b69-4dcc-b7d8-b293016adc7a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:26.051020 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7d37f713-6b69-4dcc-b7d8-b293016adc7a tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1314 microversion: 2.1 time: 0.158257 Jun 02 16:10:26.051577 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 226/461] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:25 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:26.233459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-21e21308-6b35-4e25-b6f9-1e381d35d318 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:26.234094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-21e21308-6b35-4e25-b6f9-1e381d35d318 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:26.236031 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:26.240853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21e21308-6b35-4e25-b6f9-1e381d35d318 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:26.241302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21e21308-6b35-4e25-b6f9-1e381d35d318 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:26.242062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21e21308-6b35-4e25-b6f9-1e381d35d318 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:26.242524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21e21308-6b35-4e25-b6f9-1e381d35d318 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:26.373231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-21e21308-6b35-4e25-b6f9-1e381d35d318 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:26.380610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-21e21308-6b35-4e25-b6f9-1e381d35d318 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.151984 Jun 02 16:10:26.381159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 236/462] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:26 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:27.067848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ef774759-e09e-41ea-b7a4-f5684264e4fb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:27.068473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ef774759-e09e-41ea-b7a4-f5684264e4fb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:27.070465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=8 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:27.075944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef774759-e09e-41ea-b7a4-f5684264e4fb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:27.076398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef774759-e09e-41ea-b7a4-f5684264e4fb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:27.077165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef774759-e09e-41ea-b7a4-f5684264e4fb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:27.077608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef774759-e09e-41ea-b7a4-f5684264e4fb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:27.210163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ef774759-e09e-41ea-b7a4-f5684264e4fb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:27.217914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ef774759-e09e-41ea-b7a4-f5684264e4fb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1497 microversion: 2.1 time: 0.153946 Jun 02 16:10:27.218517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 227/463] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:27 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:27.397756 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cb66b499-3547-414d-9ef8-d7f4d63fca3c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:27.398412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cb66b499-3547-414d-9ef8-d7f4d63fca3c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:27.400243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=10 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:27.405768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb66b499-3547-414d-9ef8-d7f4d63fca3c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:27.406245 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb66b499-3547-414d-9ef8-d7f4d63fca3c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:27.407009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb66b499-3547-414d-9ef8-d7f4d63fca3c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:27.407435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb66b499-3547-414d-9ef8-d7f4d63fca3c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:27.537687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cb66b499-3547-414d-9ef8-d7f4d63fca3c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:27.546443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cb66b499-3547-414d-9ef8-d7f4d63fca3c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.152450 Jun 02 16:10:27.547016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 237/464] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:27 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:28.259011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6baf5c8b-d42b-4205-9575-8676b7da33ff tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:28.259577 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6baf5c8b-d42b-4205-9575-8676b7da33ff tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:28.266964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6baf5c8b-d42b-4205-9575-8676b7da33ff tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:28.267420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6baf5c8b-d42b-4205-9575-8676b7da33ff tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:28.268277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6baf5c8b-d42b-4205-9575-8676b7da33ff tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:28.268734 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6baf5c8b-d42b-4205-9575-8676b7da33ff tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:28.297237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6baf5c8b-d42b-4205-9575-8676b7da33ff tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Going to try to terminate instance {{(pid=118257) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:10:28.563046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-38807fd5-b8f0-42b2-9881-5863b49c643f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:28.563572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-38807fd5-b8f0-42b2-9881-5863b49c643f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:28.569431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38807fd5-b8f0-42b2-9881-5863b49c643f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:28.569872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38807fd5-b8f0-42b2-9881-5863b49c643f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:28.573247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38807fd5-b8f0-42b2-9881-5863b49c643f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:28.573247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38807fd5-b8f0-42b2-9881-5863b49c643f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:28.786946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-38807fd5-b8f0-42b2-9881-5863b49c643f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:28.795434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-38807fd5-b8f0-42b2-9881-5863b49c643f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.236229 Jun 02 16:10:28.795997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 238/465] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:28 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:28.977783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6baf5c8b-d42b-4205-9575-8676b7da33ff tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 204 len: 0 microversion: 2.1 time: 0.722677 Jun 02 16:10:28.978484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 228/466] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:10:28 2022] DELETE /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:10:28.987619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-40e99bac-98df-4719-9df0-50d58f69230e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:28.988228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-40e99bac-98df-4719-9df0-50d58f69230e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:28.994423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40e99bac-98df-4719-9df0-50d58f69230e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:28.998493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40e99bac-98df-4719-9df0-50d58f69230e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:28.999343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40e99bac-98df-4719-9df0-50d58f69230e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:28.999796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40e99bac-98df-4719-9df0-50d58f69230e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:29.133556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-40e99bac-98df-4719-9df0-50d58f69230e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:29.141268 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-40e99bac-98df-4719-9df0-50d58f69230e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1503 microversion: 2.1 time: 0.157484 Jun 02 16:10:29.141928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 239/467] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:28 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:29.383441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-28fdfd6c-3c22-42fb-ad04-04239a62e42a req-2cd0c10e-9929-4c2a-96c2-8cfdec0a7be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f134ba8b-93f9-4db0-ae59-985dcfaa5221", "name": "network-vif-plugged", "status": "completed", "tag": "8800c6b1-d740-418c-8957-3683c482c442"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:29.392637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-28fdfd6c-3c22-42fb-ad04-04239a62e42a req-2cd0c10e-9929-4c2a-96c2-8cfdec0a7be7 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:29.393077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-28fdfd6c-3c22-42fb-ad04-04239a62e42a req-2cd0c10e-9929-4c2a-96c2-8cfdec0a7be7 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:29.407048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-28fdfd6c-3c22-42fb-ad04-04239a62e42a req-2cd0c10e-9929-4c2a-96c2-8cfdec0a7be7 service nova] Creating event network-vif-plugged:8800c6b1-d740-418c-8957-3683c482c442 for instance f134ba8b-93f9-4db0-ae59-985dcfaa5221 on hv-cinder-79760 Jun 02 16:10:29.411905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-28fdfd6c-3c22-42fb-ad04-04239a62e42a req-2cd0c10e-9929-4c2a-96c2-8cfdec0a7be7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032476 Jun 02 16:10:29.412509 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 229/468] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:10:29.813496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-751b36a8-8cc4-4c62-acb9-4c4eb023d0de tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:29.814200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-751b36a8-8cc4-4c62-acb9-4c4eb023d0de tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:29.821045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-751b36a8-8cc4-4c62-acb9-4c4eb023d0de tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:29.821523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-751b36a8-8cc4-4c62-acb9-4c4eb023d0de tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:29.822362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-751b36a8-8cc4-4c62-acb9-4c4eb023d0de tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:29.823512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-751b36a8-8cc4-4c62-acb9-4c4eb023d0de tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:29.957972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-751b36a8-8cc4-4c62-acb9-4c4eb023d0de tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:29.965727 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-751b36a8-8cc4-4c62-acb9-4c4eb023d0de tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.156303 Jun 02 16:10:29.966314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 240/469] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:29 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:30.159949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c14bd071-80c6-4e0e-a128-b86526e59fbe tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:30.160778 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c14bd071-80c6-4e0e-a128-b86526e59fbe tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:30.167627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c14bd071-80c6-4e0e-a128-b86526e59fbe tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:30.168083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c14bd071-80c6-4e0e-a128-b86526e59fbe tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:30.174949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c14bd071-80c6-4e0e-a128-b86526e59fbe tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:30.174949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c14bd071-80c6-4e0e-a128-b86526e59fbe tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:30.306411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c14bd071-80c6-4e0e-a128-b86526e59fbe tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:30.316019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c14bd071-80c6-4e0e-a128-b86526e59fbe tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1503 microversion: 2.1 time: 0.160291 Jun 02 16:10:30.316584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 230/470] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:30 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:30.982404 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-532b3c34-1482-4016-b80e-9602f544e2cb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:30.983082 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-532b3c34-1482-4016-b80e-9602f544e2cb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:30.989286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-532b3c34-1482-4016-b80e-9602f544e2cb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:30.989731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-532b3c34-1482-4016-b80e-9602f544e2cb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:30.990597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-532b3c34-1482-4016-b80e-9602f544e2cb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:30.991011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-532b3c34-1482-4016-b80e-9602f544e2cb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:31.125606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-532b3c34-1482-4016-b80e-9602f544e2cb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:31.133039 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-532b3c34-1482-4016-b80e-9602f544e2cb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.155041 Jun 02 16:10:31.133747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 241/471] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:30 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:31.333458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-59875f55-72ed-4b11-8f6d-204dabfe9d1c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:31.334516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-59875f55-72ed-4b11-8f6d-204dabfe9d1c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:31.342398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59875f55-72ed-4b11-8f6d-204dabfe9d1c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:31.342398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59875f55-72ed-4b11-8f6d-204dabfe9d1c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:31.343372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59875f55-72ed-4b11-8f6d-204dabfe9d1c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:31.343956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59875f55-72ed-4b11-8f6d-204dabfe9d1c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:31.477931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-59875f55-72ed-4b11-8f6d-204dabfe9d1c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:31.486505 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-59875f55-72ed-4b11-8f6d-204dabfe9d1c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1503 microversion: 2.1 time: 0.156854 Jun 02 16:10:31.487200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 231/472] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:31 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:31.892039 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-c3d9c2f5-3a3b-4b5f-a78c-e7d785e24a31 req-d0122573-aae4-4c64-94e5-6edfd7766dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8f7801-8144-4b99-95a2-d093dd5479a0", "name": "network-vif-deleted", "tag": "0003edb1-d8a7-4a0e-aac4-bb3212156564"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:31.902067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-c3d9c2f5-3a3b-4b5f-a78c-e7d785e24a31 req-d0122573-aae4-4c64-94e5-6edfd7766dbd service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:31.902652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-c3d9c2f5-3a3b-4b5f-a78c-e7d785e24a31 req-d0122573-aae4-4c64-94e5-6edfd7766dbd service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:31.914240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-c3d9c2f5-3a3b-4b5f-a78c-e7d785e24a31 req-d0122573-aae4-4c64-94e5-6edfd7766dbd service nova] Creating event network-vif-deleted:0003edb1-d8a7-4a0e-aac4-bb3212156564 for instance 9b8f7801-8144-4b99-95a2-d093dd5479a0 on hv-cinder-79760 Jun 02 16:10:31.919900 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-c3d9c2f5-3a3b-4b5f-a78c-e7d785e24a31 req-d0122573-aae4-4c64-94e5-6edfd7766dbd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031861 Jun 02 16:10:31.920496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 242/473] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:32.149315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b4f97439-9087-4146-b521-63c2b1f0f264 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:32.149918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b4f97439-9087-4146-b521-63c2b1f0f264 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:32.156058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4f97439-9087-4146-b521-63c2b1f0f264 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:32.156498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4f97439-9087-4146-b521-63c2b1f0f264 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:32.157246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4f97439-9087-4146-b521-63c2b1f0f264 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:32.157674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4f97439-9087-4146-b521-63c2b1f0f264 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:32.303193 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b4f97439-9087-4146-b521-63c2b1f0f264 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:32.311865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b4f97439-9087-4146-b521-63c2b1f0f264 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.166420 Jun 02 16:10:32.312374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 232/474] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:32 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:32.504878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d2e83e70-0d9c-4b97-815e-f855a0726361 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:32.505588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d2e83e70-0d9c-4b97-815e-f855a0726361 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:32.512298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2e83e70-0d9c-4b97-815e-f855a0726361 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:32.512742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2e83e70-0d9c-4b97-815e-f855a0726361 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:32.513512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2e83e70-0d9c-4b97-815e-f855a0726361 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:32.513949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2e83e70-0d9c-4b97-815e-f855a0726361 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:32.577266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d2e83e70-0d9c-4b97-815e-f855a0726361 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:32.585379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d2e83e70-0d9c-4b97-815e-f855a0726361 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1299 microversion: 2.1 time: 0.084774 Jun 02 16:10:32.585955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 243/475] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:32 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:33.329107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7e2b337c-e463-449e-ae85-6ba279d1c0e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:33.329733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7e2b337c-e463-449e-ae85-6ba279d1c0e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:33.336531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e2b337c-e463-449e-ae85-6ba279d1c0e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:33.336984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e2b337c-e463-449e-ae85-6ba279d1c0e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:33.337755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e2b337c-e463-449e-ae85-6ba279d1c0e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:33.338236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e2b337c-e463-449e-ae85-6ba279d1c0e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:33.473679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7e2b337c-e463-449e-ae85-6ba279d1c0e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:33.482260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7e2b337c-e463-449e-ae85-6ba279d1c0e1 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1315 microversion: 2.1 time: 0.156755 Jun 02 16:10:33.482906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 233/476] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:33 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:33.604119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:33.604862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:33.610658 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:33.611094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:33.611851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:33.612287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:33.648089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:33.648532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:33.648975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lazy-loading 'fault' on Instance uuid 9b8f7801-8144-4b99-95a2-d093dd5479a0 {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:10:33.689211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:33.700311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c32435df-d0ed-47ac-a816-8e1e89b6a213 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1304 microversion: 2.1 time: 0.100051 Jun 02 16:10:33.700934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 244/477] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:33 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:34.506499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fc8ff3c0-b9af-4c27-a01f-3c862d59829c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:34.507245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fc8ff3c0-b9af-4c27-a01f-3c862d59829c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:34.514759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc8ff3c0-b9af-4c27-a01f-3c862d59829c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:34.515211 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc8ff3c0-b9af-4c27-a01f-3c862d59829c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:34.515983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc8ff3c0-b9af-4c27-a01f-3c862d59829c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:34.516422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc8ff3c0-b9af-4c27-a01f-3c862d59829c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:34.649480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fc8ff3c0-b9af-4c27-a01f-3c862d59829c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:34.657774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fc8ff3c0-b9af-4c27-a01f-3c862d59829c tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1465 microversion: 2.1 time: 0.155004 Jun 02 16:10:34.658370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 234/478] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:34 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:34.696353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e7ef8531-c904-4d79-b7fa-2d9180a034cc tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:34.696842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e7ef8531-c904-4d79-b7fa-2d9180a034cc tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:34.704214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e7ef8531-c904-4d79-b7fa-2d9180a034cc tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:34.704661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e7ef8531-c904-4d79-b7fa-2d9180a034cc tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:34.705467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e7ef8531-c904-4d79-b7fa-2d9180a034cc tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:34.705897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e7ef8531-c904-4d79-b7fa-2d9180a034cc tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:34.717739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:34.718376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:34.724320 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:34.724800 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:34.725560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:34.735079 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:34.735203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e7ef8531-c904-4d79-b7fa-2d9180a034cc tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:10:34.755882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:34.756249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:34.756697 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lazy-loading 'fault' on Instance uuid 9b8f7801-8144-4b99-95a2-d093dd5479a0 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:10:34.805746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:34.813346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cc0968e9-44eb-44c8-af58-129e4bc51069 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1304 microversion: 2.1 time: 0.100317 Jun 02 16:10:34.813908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 235/479] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:34 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:35.085741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e7ef8531-c904-4d79-b7fa-2d9180a034cc tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 204 len: 0 microversion: 2.1 time: 0.392823 Jun 02 16:10:35.086267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 245/480] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:10:34 2022] DELETE /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:10:35.095573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-337d9f35-f14c-48fa-9d96-e4671902d309 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:35.096191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-337d9f35-f14c-48fa-9d96-e4671902d309 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:35.102396 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-337d9f35-f14c-48fa-9d96-e4671902d309 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:35.102848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-337d9f35-f14c-48fa-9d96-e4671902d309 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:35.103615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-337d9f35-f14c-48fa-9d96-e4671902d309 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:35.104771 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-337d9f35-f14c-48fa-9d96-e4671902d309 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:35.243237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-337d9f35-f14c-48fa-9d96-e4671902d309 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:35.251319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-337d9f35-f14c-48fa-9d96-e4671902d309 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1471 microversion: 2.1 time: 0.159631 Jun 02 16:10:35.251887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 236/481] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:35 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:35.533755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-33dd5874-3bde-4483-839a-7c14b013eb12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:35.534367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-33dd5874-3bde-4483-839a-7c14b013eb12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:35.540991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33dd5874-3bde-4483-839a-7c14b013eb12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:35.541979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33dd5874-3bde-4483-839a-7c14b013eb12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:35.543001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33dd5874-3bde-4483-839a-7c14b013eb12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:35.543444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33dd5874-3bde-4483-839a-7c14b013eb12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:35.547134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:35.566823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-33dd5874-3bde-4483-839a-7c14b013eb12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/ips" status: 200 len: 145 microversion: 2.1 time: 0.037283 Jun 02 16:10:35.567379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 246/482] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 2 16:10:35 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:35.830289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:35.831009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:35.837699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:35.838845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:35.840141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:35.840836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:35.872636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:35.873083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:35.873529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lazy-loading 'fault' on Instance uuid 9b8f7801-8144-4b99-95a2-d093dd5479a0 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:10:35.914634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:35.922706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4c20de7d-d2d9-46bd-b96a-1d45520f5784 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1304 microversion: 2.1 time: 0.096403 Jun 02 16:10:35.923267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 237/483] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:35 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:36.268901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-946bcaaf-9d90-48d1-b2fa-c73938b4a88f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:36.269253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-946bcaaf-9d90-48d1-b2fa-c73938b4a88f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:36.275899 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-946bcaaf-9d90-48d1-b2fa-c73938b4a88f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:36.276343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-946bcaaf-9d90-48d1-b2fa-c73938b4a88f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:36.277729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-946bcaaf-9d90-48d1-b2fa-c73938b4a88f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:36.278200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-946bcaaf-9d90-48d1-b2fa-c73938b4a88f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:36.414487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-946bcaaf-9d90-48d1-b2fa-c73938b4a88f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:36.423853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-946bcaaf-9d90-48d1-b2fa-c73938b4a88f tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1471 microversion: 2.1 time: 0.159316 Jun 02 16:10:36.424495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 247/484] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:36 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:36.940274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:36.941000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:36.947552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:36.948003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:36.948990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:36.949891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:36.982284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:36.982732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:36.983307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lazy-loading 'fault' on Instance uuid 9b8f7801-8144-4b99-95a2-d093dd5479a0 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:10:37.026569 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:37.033694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1d7a682f-1570-45eb-ac79-9c570fffae08 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 200 len: 1304 microversion: 2.1 time: 0.097327 Jun 02 16:10:37.034219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 238/485] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:36 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:37.440712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-96e228d3-1e80-4c46-b25e-13e2902985fb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:37.441325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-96e228d3-1e80-4c46-b25e-13e2902985fb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:37.443253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:37.447998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96e228d3-1e80-4c46-b25e-13e2902985fb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:37.448447 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96e228d3-1e80-4c46-b25e-13e2902985fb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:37.449947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96e228d3-1e80-4c46-b25e-13e2902985fb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:37.450621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96e228d3-1e80-4c46-b25e-13e2902985fb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:37.621235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-96e228d3-1e80-4c46-b25e-13e2902985fb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:37.629056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-96e228d3-1e80-4c46-b25e-13e2902985fb tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1471 microversion: 2.1 time: 0.192240 Jun 02 16:10:37.629642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 248/486] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:37 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:38.051123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:38.051728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 9b8f7801-8144-4b99-95a2-d093dd5479a0] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:38.058696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:38.060141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:38.060141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:38.060557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:38.075426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] HTTP exception thrown: Instance 9b8f7801-8144-4b99-95a2-d093dd5479a0 could not be found. Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Request method failure captured: Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 HTTP/1.1 Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimODYHjKVCgN7WPlUjSeEtvFLyuyW2cfwjKWijYOyZrSJFyjMHEkhx2LSvUVDff_jTSyIqmmQIVgEPH6UVLknTUtn0DuSyAtNY6jcZcu1Wy_BxdQUy5CPjTRsXhkvxuVCwRroGT-Q975yWp7yP-f_lI_RuXLDOKRIZPHoCSacsn1TGIE Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: b42e4a202a4942818fd25d0f25abe9de Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-VolumesActionsTest-700176584 Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:10:38.076826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b42e4a202a4942818fd25d0f25abe9de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b42e4a202a4942818fd25d0f25abe9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b42e4a202a4942818fd25d0f25abe9de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b42e4a202a4942818fd25d0f25abe9de"}]}] Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-VolumesActionsTest-700176584 Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: b42e4a202a4942818fd25d0f25abe9de Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-VolumesActionsTest-700176584 Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-VolumesActionsTest-700176584-project Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: e1dbb393020e452fb78d212cf60a2a72 Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-VolumesActionsTest-700176584-project Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 9b8f7801-8144-4b99-95a2-d093dd5479a0 could not be found. Jun 02 16:10:38.078313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '9b8f7801-8144-4b99-95a2-d093dd5479a0'} Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8f7801-8144-4b99-95a2-d093dd5479a0 could not be found. Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:10:38.079148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8f7801-8144-4b99-95a2-d093dd5479a0 could not be found. Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8f7801-8144-4b99-95a2-d093dd5479a0 could not be found. Jun 02 16:10:38.080639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:10:38.082207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Returning 404 to user: Instance 9b8f7801-8144-4b99-95a2-d093dd5479a0 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:10:38.082207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1ab7f996-0f0f-497f-aae8-2f92511547a1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0" status: 404 len: 111 microversion: 2.1 time: 0.031101 Jun 02 16:10:38.082207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 239/487] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:38 2022] GET /compute/v2.1/servers/9b8f7801-8144-4b99-95a2-d093dd5479a0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:10:38.151820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-b6ff3b43-3c4d-4c87-b556-17671cef4297 req-130a078a-b92f-4a91-94a7-3c06891f9595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f134ba8b-93f9-4db0-ae59-985dcfaa5221", "name": "network-vif-deleted", "tag": "8800c6b1-d740-418c-8957-3683c482c442"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:38.160720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-b6ff3b43-3c4d-4c87-b556-17671cef4297 req-130a078a-b92f-4a91-94a7-3c06891f9595 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:38.161165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-b6ff3b43-3c4d-4c87-b556-17671cef4297 req-130a078a-b92f-4a91-94a7-3c06891f9595 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:38.175539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-b6ff3b43-3c4d-4c87-b556-17671cef4297 req-130a078a-b92f-4a91-94a7-3c06891f9595 service nova] Creating event network-vif-deleted:8800c6b1-d740-418c-8957-3683c482c442 for instance f134ba8b-93f9-4db0-ae59-985dcfaa5221 on hv-cinder-79760 Jun 02 16:10:38.180448 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-b6ff3b43-3c4d-4c87-b556-17671cef4297 req-130a078a-b92f-4a91-94a7-3c06891f9595 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032853 Jun 02 16:10:38.181371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 249/488] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:38.199487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1060558592", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "networks": [{"uuid": "3760d56b-dc2b-4667-8533-d72e68f76d1b"}]}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:38.256477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] validate_networks() for [('3760d56b-dc2b-4667-8533-d72e68f76d1b', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:10:38.620751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:10:38.621716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:10:38.622246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:10:38.622665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:10:38.623081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:10:38.632072 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:38.632520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:38.633338 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:38.633778 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:38.647636 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:38.648449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:38.651374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Getting quotas for project b42e4a202a4942818fd25d0f25abe9de. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:10:38.655265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:38.655712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:38.656454 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Getting quotas for user e1dbb393020e452fb78d212cf60a2a72 and project b42e4a202a4942818fd25d0f25abe9de. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:10:38.656581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:38.656883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:38.669372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:10:38.671692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:10:38.688792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:38.689276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:38.689732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lazy-loading 'fault' on Instance uuid f134ba8b-93f9-4db0-ae59-985dcfaa5221 {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:10:38.732523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c622005135854b0c9984f5851b300e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c053fa2e3254a849acdb5116ec9644b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:38.739857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-610ab4e9-b863-4a25-a1a4-18cc09d139d8 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 200 len: 1305 microversion: 2.1 time: 0.096370 Jun 02 16:10:38.740416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 250/489] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:38 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:38.765065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-77ad8112-93fb-4e86-80be-82421501a62e tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569520 Jun 02 16:10:38.765735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 240/490] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:10:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 16:10:38.775622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3c9067d1-d635-428f-9ae0-9f427fff8bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:38.776234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3c9067d1-d635-428f-9ae0-9f427fff8bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:38.828841 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3c9067d1-d635-428f-9ae0-9f427fff8bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:38.835713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3c9067d1-d635-428f-9ae0-9f427fff8bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1214 microversion: 2.1 time: 0.063948 Jun 02 16:10:38.836838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 251/491] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:38 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:39.535704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c075664a-6149-4e2d-8eb3-4a1228371bc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f4a0cd7-ce8a-407c-ba46-96dbf8083890"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:39.536924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c075664a-6149-4e2d-8eb3-4a1228371bc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:39.544501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c075664a-6149-4e2d-8eb3-4a1228371bc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:39.544991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c075664a-6149-4e2d-8eb3-4a1228371bc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:39.545843 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c075664a-6149-4e2d-8eb3-4a1228371bc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:39.546409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c075664a-6149-4e2d-8eb3-4a1228371bc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:39.617212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:39.756860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:39.757494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] [instance: f134ba8b-93f9-4db0-ae59-985dcfaa5221] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:39.764310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:39.764861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:39.765662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:39.766120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:39.780920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] HTTP exception thrown: Instance f134ba8b-93f9-4db0-ae59-985dcfaa5221 could not be found. Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Request method failure captured: Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 HTTP/1.1 Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimODj8d0PMPiAEeIkB2deVTwpgeT2EOYpKb0ou4wbHVZxPA6GpsC5fV2iJPPpQyni6f63bfjCPVaAL7vPL8NsPXa-NYAayKz2AfFwDvN3ILeto2rUJCvO86r-7_mJ77li-EWTe_M0FPal86SZiIF4WZPcy5FjyccMB_tuuo2o7LTYQ7Q Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 0c053fa2e3254a849acdb5116ec9644b Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesNegativeTest-949547166 Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:10:39.782714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0c053fa2e3254a849acdb5116ec9644b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c053fa2e3254a849acdb5116ec9644b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0c053fa2e3254a849acdb5116ec9644b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0c053fa2e3254a849acdb5116ec9644b"}]}] Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesNegativeTest-949547166 Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 0c053fa2e3254a849acdb5116ec9644b Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesNegativeTest-949547166 Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesNegativeTest-949547166-project Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: c622005135854b0c9984f5851b300e8e Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesNegativeTest-949547166-project Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance f134ba8b-93f9-4db0-ae59-985dcfaa5221 could not be found. Jun 02 16:10:39.784307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': 'f134ba8b-93f9-4db0-ae59-985dcfaa5221'} Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f134ba8b-93f9-4db0-ae59-985dcfaa5221 could not be found. Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:10:39.785147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f134ba8b-93f9-4db0-ae59-985dcfaa5221 could not be found. Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f134ba8b-93f9-4db0-ae59-985dcfaa5221 could not be found. Jun 02 16:10:39.786625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:10:39.787851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] Returning 404 to user: Instance f134ba8b-93f9-4db0-ae59-985dcfaa5221 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:10:39.787851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1bdfd9c3-55ef-4297-958c-4a80520f1784 tempest-VolumesNegativeTest-949547166 tempest-VolumesNegativeTest-949547166-project] 10.222.0.59 "GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221" status: 404 len: 111 microversion: 2.1 time: 0.031280 Jun 02 16:10:39.787851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 252/492] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:39 2022] GET /compute/v2.1/servers/f134ba8b-93f9-4db0-ae59-985dcfaa5221 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 16:10:39.855868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-10e98c7f-5ee8-4589-a2c4-0efa5feb58a5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:39.856490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-10e98c7f-5ee8-4589-a2c4-0efa5feb58a5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:39.865549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-10e98c7f-5ee8-4589-a2c4-0efa5feb58a5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:39.866178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-10e98c7f-5ee8-4589-a2c4-0efa5feb58a5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:39.866853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-10e98c7f-5ee8-4589-a2c4-0efa5feb58a5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:39.867257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-10e98c7f-5ee8-4589-a2c4-0efa5feb58a5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:39.939120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-10e98c7f-5ee8-4589-a2c4-0efa5feb58a5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:39.946499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-10e98c7f-5ee8-4589-a2c4-0efa5feb58a5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1218 microversion: 2.1 time: 0.096263 Jun 02 16:10:39.947074 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 253/493] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:39 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:40.735979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c075664a-6149-4e2d-8eb3-4a1228371bc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.204749 Jun 02 16:10:40.737026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 241/494] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:10:39 2022] POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/os-volume_attachments => generated 194 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:40.963379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-55659879-bfdd-4135-ae41-4b1f6a4ae97c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:40.964087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-55659879-bfdd-4135-ae41-4b1f6a4ae97c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:40.970998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55659879-bfdd-4135-ae41-4b1f6a4ae97c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:40.971450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55659879-bfdd-4135-ae41-4b1f6a4ae97c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:40.972215 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55659879-bfdd-4135-ae41-4b1f6a4ae97c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:40.972650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55659879-bfdd-4135-ae41-4b1f6a4ae97c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:41.034254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-55659879-bfdd-4135-ae41-4b1f6a4ae97c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:41.041521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-55659879-bfdd-4135-ae41-4b1f6a4ae97c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1266 microversion: 2.1 time: 0.082061 Jun 02 16:10:41.042077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 254/495] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:40 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:42.060815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b814b181-a0ae-46c4-ae0a-5878eb4face4 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:42.061480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b814b181-a0ae-46c4-ae0a-5878eb4face4 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:42.079465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b814b181-a0ae-46c4-ae0a-5878eb4face4 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:42.079959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b814b181-a0ae-46c4-ae0a-5878eb4face4 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:42.080848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b814b181-a0ae-46c4-ae0a-5878eb4face4 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:42.081313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b814b181-a0ae-46c4-ae0a-5878eb4face4 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:42.223846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b814b181-a0ae-46c4-ae0a-5878eb4face4 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:42.234108 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b814b181-a0ae-46c4-ae0a-5878eb4face4 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.176261 Jun 02 16:10:42.234108 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 242/496] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:42 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:42.998394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-289bdffd-c179-4be5-b38e-a58496a517c1 req-cde3bdd5-4797-4b9c-8617-446a5e720cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821b1dbf-372d-4dc9-8365-97d4c5ba31a5", "tag": "3c66c484-3019-4bf5-9d79-0403808ec4e9"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:43.006942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-289bdffd-c179-4be5-b38e-a58496a517c1 req-cde3bdd5-4797-4b9c-8617-446a5e720cb3 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:43.007388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-289bdffd-c179-4be5-b38e-a58496a517c1 req-cde3bdd5-4797-4b9c-8617-446a5e720cb3 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:43.023284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-289bdffd-c179-4be5-b38e-a58496a517c1 req-cde3bdd5-4797-4b9c-8617-446a5e720cb3 service nova] Creating event network-changed:3c66c484-3019-4bf5-9d79-0403808ec4e9 for instance 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 on hv-cinder-79760 Jun 02 16:10:43.029209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-289bdffd-c179-4be5-b38e-a58496a517c1 req-cde3bdd5-4797-4b9c-8617-446a5e720cb3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035760 Jun 02 16:10:43.029843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 255/497] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:10:43.249440 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b1189d2f-7e89-415e-8706-30110f1a9f85 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:43.250087 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b1189d2f-7e89-415e-8706-30110f1a9f85 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:43.256682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b1189d2f-7e89-415e-8706-30110f1a9f85 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:43.261915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b1189d2f-7e89-415e-8706-30110f1a9f85 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:43.261915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b1189d2f-7e89-415e-8706-30110f1a9f85 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:43.261915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b1189d2f-7e89-415e-8706-30110f1a9f85 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:43.394458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b1189d2f-7e89-415e-8706-30110f1a9f85 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:43.404158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b1189d2f-7e89-415e-8706-30110f1a9f85 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.159108 Jun 02 16:10:43.404892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 243/498] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:43 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:44.421890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8ee676a8-9b57-4b6e-8940-15d0950e7bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:44.422700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8ee676a8-9b57-4b6e-8940-15d0950e7bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:44.429173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ee676a8-9b57-4b6e-8940-15d0950e7bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:44.429617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ee676a8-9b57-4b6e-8940-15d0950e7bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:44.430402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ee676a8-9b57-4b6e-8940-15d0950e7bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:44.430843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ee676a8-9b57-4b6e-8940-15d0950e7bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:44.564569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8ee676a8-9b57-4b6e-8940-15d0950e7bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:44.572079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8ee676a8-9b57-4b6e-8940-15d0950e7bd5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.154933 Jun 02 16:10:44.572654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 256/499] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:44 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:45.589231 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ce964626-dc32-4930-bd3d-2c35279d17e6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:45.590786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ce964626-dc32-4930-bd3d-2c35279d17e6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:45.593084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:45.597959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce964626-dc32-4930-bd3d-2c35279d17e6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:45.598441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce964626-dc32-4930-bd3d-2c35279d17e6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:45.604246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce964626-dc32-4930-bd3d-2c35279d17e6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:45.604246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce964626-dc32-4930-bd3d-2c35279d17e6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:45.734164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ce964626-dc32-4930-bd3d-2c35279d17e6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:45.742309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ce964626-dc32-4930-bd3d-2c35279d17e6 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.156902 Jun 02 16:10:45.742939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 244/500] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:45 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:46.760325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c56c83ff-2bce-40f7-95c3-49f81d73b2f9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:46.760937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c56c83ff-2bce-40f7-95c3-49f81d73b2f9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:46.767791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c56c83ff-2bce-40f7-95c3-49f81d73b2f9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:46.768224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c56c83ff-2bce-40f7-95c3-49f81d73b2f9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:46.768984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c56c83ff-2bce-40f7-95c3-49f81d73b2f9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:46.769515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c56c83ff-2bce-40f7-95c3-49f81d73b2f9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:46.907526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c56c83ff-2bce-40f7-95c3-49f81d73b2f9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:46.911231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c56c83ff-2bce-40f7-95c3-49f81d73b2f9 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.154806 Jun 02 16:10:46.911795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 257/501] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:46 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:47.929899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a324ffd9-83d0-4b76-96fe-a6d1c97d8632 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:47.930552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a324ffd9-83d0-4b76-96fe-a6d1c97d8632 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:47.937549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a324ffd9-83d0-4b76-96fe-a6d1c97d8632 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:47.941327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a324ffd9-83d0-4b76-96fe-a6d1c97d8632 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:47.941327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a324ffd9-83d0-4b76-96fe-a6d1c97d8632 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:47.941327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a324ffd9-83d0-4b76-96fe-a6d1c97d8632 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:48.080515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a324ffd9-83d0-4b76-96fe-a6d1c97d8632 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:48.088081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a324ffd9-83d0-4b76-96fe-a6d1c97d8632 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.162374 Jun 02 16:10:48.088686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 245/502] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:47 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:49.106352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2e95f51a-abf7-4764-a868-24e5898cfa10 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:49.106991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2e95f51a-abf7-4764-a868-24e5898cfa10 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:49.108960 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:49.114376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e95f51a-abf7-4764-a868-24e5898cfa10 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:49.114823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e95f51a-abf7-4764-a868-24e5898cfa10 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:49.115576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e95f51a-abf7-4764-a868-24e5898cfa10 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:49.116001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e95f51a-abf7-4764-a868-24e5898cfa10 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:49.137433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-849867643", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2029801029", "security_groups": [{"name": "tempest-secgroup-smoke-176932315"}], "networks": [{"uuid": "4a67dc07-94f8-4f2f-9e0e-94acca89ee37"}], "block_device_mapping_v2": [{"uuid": "fdd0a981-fe2d-4b8a-81ac-bf3bb232489d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:49.145646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:49.146348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=6 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:49.258831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2e95f51a-abf7-4764-a868-24e5898cfa10 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:49.260361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] validate_networks() for [('4a67dc07-94f8-4f2f-9e0e-94acca89ee37', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:10:49.267510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2e95f51a-abf7-4764-a868-24e5898cfa10 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.165653 Jun 02 16:10:49.268217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 258/503] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:49 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:49.631767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:10:49.632254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:10:49.632762 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:10:49.633233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:10:49.633649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:10:49.645473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:49.645908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:49.646770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:49.647485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:49.666110 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Getting quotas for project aa7bcb5f489f4a2db902c2035d9879a5. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:10:49.670410 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Getting quotas for user 2f09d7a733fa43a7a45f56176c752447 and project aa7bcb5f489f4a2db902c2035d9879a5. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:10:49.727807 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:10:49.729925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fdd0a981-fe2d-4b8a-81ac-bf3bb232489d',volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:10:50.087059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-59a4e6bb-fbf7-47a9-980d-424607ef35cb req-76465e58-0558-46f2-99bb-b2b33010fa89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821b1dbf-372d-4dc9-8365-97d4c5ba31a5", "name": "network-vif-plugged", "status": "completed", "tag": "3c66c484-3019-4bf5-9d79-0403808ec4e9"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:50.095703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-59a4e6bb-fbf7-47a9-980d-424607ef35cb req-76465e58-0558-46f2-99bb-b2b33010fa89 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:50.096140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-59a4e6bb-fbf7-47a9-980d-424607ef35cb req-76465e58-0558-46f2-99bb-b2b33010fa89 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:50.108100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-59a4e6bb-fbf7-47a9-980d-424607ef35cb req-76465e58-0558-46f2-99bb-b2b33010fa89 service nova] Creating event network-vif-plugged:3c66c484-3019-4bf5-9d79-0403808ec4e9 for instance 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 on hv-cinder-79760 Jun 02 16:10:50.113170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-59a4e6bb-fbf7-47a9-980d-424607ef35cb req-76465e58-0558-46f2-99bb-b2b33010fa89 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029849 Jun 02 16:10:50.113761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 259/504] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:10:50.285703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-df8cb40c-390e-41ed-b744-5cf58d27720d tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:50.286616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-df8cb40c-390e-41ed-b744-5cf58d27720d tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:50.294475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df8cb40c-390e-41ed-b744-5cf58d27720d tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:50.294965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df8cb40c-390e-41ed-b744-5cf58d27720d tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:50.295746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df8cb40c-390e-41ed-b744-5cf58d27720d tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:50.296213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df8cb40c-390e-41ed-b744-5cf58d27720d tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:50.379857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-40344406-1a3d-45e0-8a03-42c4152962ac tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.246602 Jun 02 16:10:50.381219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 246/505] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:10:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 16:10:50.403732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-52790d8a-b516-450f-911b-e9f75b0b65ce tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:50.404631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-52790d8a-b516-450f-911b-e9f75b0b65ce tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:50.461134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-df8cb40c-390e-41ed-b744-5cf58d27720d tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:50.470170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-df8cb40c-390e-41ed-b744-5cf58d27720d tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.188592 Jun 02 16:10:50.470756 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 260/506] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:50 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:50.472362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-52790d8a-b516-450f-911b-e9f75b0b65ce tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:50.475896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bae8125a-3970-4c57-a4b1-d15a55fb6627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:50.482738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bae8125a-3970-4c57-a4b1-d15a55fb6627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:50.483209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bae8125a-3970-4c57-a4b1-d15a55fb6627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:50.484342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-52790d8a-b516-450f-911b-e9f75b0b65ce tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1088 microversion: 2.1 time: 0.089548 Jun 02 16:10:50.485012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 247/507] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:50 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1088 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:50.549457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bae8125a-3970-4c57-a4b1-d15a55fb6627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Going to try to stop instance {{(pid=118256) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 16:10:50.803267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bae8125a-3970-4c57-a4b1-d15a55fb6627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/action" status: 202 len: 0 microversion: 2.1 time: 0.330853 Jun 02 16:10:50.803874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 261/508] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:10:50 2022] POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:10:50.813000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8a5ea0d2-1ae9-4e7d-a006-7e17bfc4de68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:50.813879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8a5ea0d2-1ae9-4e7d-a006-7e17bfc4de68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:50.821304 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a5ea0d2-1ae9-4e7d-a006-7e17bfc4de68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:50.821831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a5ea0d2-1ae9-4e7d-a006-7e17bfc4de68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:50.822725 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a5ea0d2-1ae9-4e7d-a006-7e17bfc4de68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:50.823200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a5ea0d2-1ae9-4e7d-a006-7e17bfc4de68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:50.964610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8a5ea0d2-1ae9-4e7d-a006-7e17bfc4de68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:50.973439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8a5ea0d2-1ae9-4e7d-a006-7e17bfc4de68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.165004 Jun 02 16:10:50.974016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 248/509] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:50 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:51.489459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c922463e-3802-4a7c-bf1c-a1e13891fc5b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:51.490213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c922463e-3802-4a7c-bf1c-a1e13891fc5b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:51.496710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c922463e-3802-4a7c-bf1c-a1e13891fc5b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:51.497166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c922463e-3802-4a7c-bf1c-a1e13891fc5b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:51.497932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c922463e-3802-4a7c-bf1c-a1e13891fc5b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:51.498395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c922463e-3802-4a7c-bf1c-a1e13891fc5b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:51.502302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-82dbcd80-d0b8-4ac0-ab3f-6f4c68ee4f74 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:51.502952 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-82dbcd80-d0b8-4ac0-ab3f-6f4c68ee4f74 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:51.562591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-82dbcd80-d0b8-4ac0-ab3f-6f4c68ee4f74 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:51.569601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-82dbcd80-d0b8-4ac0-ab3f-6f4c68ee4f74 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1088 microversion: 2.1 time: 0.071249 Jun 02 16:10:51.570503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 249/510] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:51 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:51.631589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c922463e-3802-4a7c-bf1c-a1e13891fc5b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:51.639411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c922463e-3802-4a7c-bf1c-a1e13891fc5b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.154273 Jun 02 16:10:51.639974 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 262/511] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:51 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:51.992255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fba21385-e2cd-4b8f-8945-30e5260e8eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:51.992888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fba21385-e2cd-4b8f-8945-30e5260e8eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:52.000001 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fba21385-e2cd-4b8f-8945-30e5260e8eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:52.000487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fba21385-e2cd-4b8f-8945-30e5260e8eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:52.001269 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fba21385-e2cd-4b8f-8945-30e5260e8eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:52.001705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fba21385-e2cd-4b8f-8945-30e5260e8eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:52.131873 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fba21385-e2cd-4b8f-8945-30e5260e8eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:52.140522 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fba21385-e2cd-4b8f-8945-30e5260e8eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.152259 Jun 02 16:10:52.141081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 250/512] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:51 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:52.586804 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2357af05-22f6-48e4-945c-55da4d556023 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:52.587409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2357af05-22f6-48e4-945c-55da4d556023 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:52.593822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2357af05-22f6-48e4-945c-55da4d556023 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:52.594371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2357af05-22f6-48e4-945c-55da4d556023 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:52.595127 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2357af05-22f6-48e4-945c-55da4d556023 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:52.595562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2357af05-22f6-48e4-945c-55da4d556023 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:52.656060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-aa552c3a-8049-403b-897f-260eb1ea47ac tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:52.659287 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-aa552c3a-8049-403b-897f-260eb1ea47ac tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:52.659944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2357af05-22f6-48e4-945c-55da4d556023 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:52.665815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa552c3a-8049-403b-897f-260eb1ea47ac tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:52.666297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa552c3a-8049-403b-897f-260eb1ea47ac tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:52.667065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa552c3a-8049-403b-897f-260eb1ea47ac tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:52.667609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2357af05-22f6-48e4-945c-55da4d556023 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1130 microversion: 2.1 time: 0.084776 Jun 02 16:10:52.668504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa552c3a-8049-403b-897f-260eb1ea47ac tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:52.674128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 263/513] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:52 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1130 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:52.811543 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-aa552c3a-8049-403b-897f-260eb1ea47ac tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:52.819187 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-aa552c3a-8049-403b-897f-260eb1ea47ac tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1314 microversion: 2.1 time: 0.167246 Jun 02 16:10:52.819761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 251/514] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:52 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:53.159026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f31efa1a-d36e-400c-944a-964915939a34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:53.159637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f31efa1a-d36e-400c-944a-964915939a34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:53.165748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f31efa1a-d36e-400c-944a-964915939a34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:53.166242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f31efa1a-d36e-400c-944a-964915939a34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:53.167022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f31efa1a-d36e-400c-944a-964915939a34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:53.167466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f31efa1a-d36e-400c-944a-964915939a34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:53.296453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f31efa1a-d36e-400c-944a-964915939a34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:53.304244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f31efa1a-d36e-400c-944a-964915939a34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.149127 Jun 02 16:10:53.304820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 264/515] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:53 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:53.687077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e9758b8e-3742-416f-bdc5-bffcba257f60 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:53.687792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e9758b8e-3742-416f-bdc5-bffcba257f60 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:53.694039 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9758b8e-3742-416f-bdc5-bffcba257f60 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:53.694502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9758b8e-3742-416f-bdc5-bffcba257f60 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:53.695265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9758b8e-3742-416f-bdc5-bffcba257f60 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:53.695721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9758b8e-3742-416f-bdc5-bffcba257f60 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:53.757450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e9758b8e-3742-416f-bdc5-bffcba257f60 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:53.765390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e9758b8e-3742-416f-bdc5-bffcba257f60 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1186 microversion: 2.1 time: 0.084005 Jun 02 16:10:53.765949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 252/516] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:53 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:53.837048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-013baa3b-cb9f-4b06-8478-165ed95c1d3c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:53.837808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-013baa3b-cb9f-4b06-8478-165ed95c1d3c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:53.844566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-013baa3b-cb9f-4b06-8478-165ed95c1d3c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:53.845015 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-013baa3b-cb9f-4b06-8478-165ed95c1d3c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:53.846097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-013baa3b-cb9f-4b06-8478-165ed95c1d3c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:53.846540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-013baa3b-cb9f-4b06-8478-165ed95c1d3c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:53.862679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:54.056179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-013baa3b-cb9f-4b06-8478-165ed95c1d3c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:54.065125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-013baa3b-cb9f-4b06-8478-165ed95c1d3c tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1497 microversion: 2.1 time: 0.232409 Jun 02 16:10:54.079410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 265/517] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:53 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1497 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:54.323318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5111c6dc-3564-4cfb-80fa-12d380100805 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:54.324201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5111c6dc-3564-4cfb-80fa-12d380100805 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:54.330503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5111c6dc-3564-4cfb-80fa-12d380100805 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:54.330954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5111c6dc-3564-4cfb-80fa-12d380100805 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:54.336016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5111c6dc-3564-4cfb-80fa-12d380100805 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:54.336016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5111c6dc-3564-4cfb-80fa-12d380100805 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:54.481575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5111c6dc-3564-4cfb-80fa-12d380100805 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:54.481787 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5111c6dc-3564-4cfb-80fa-12d380100805 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.162970 Jun 02 16:10:54.482389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 253/518] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:54 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:54.783520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d000b105-1dfc-4a0b-9a1a-3201e0a8c2bd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:54.784157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d000b105-1dfc-4a0b-9a1a-3201e0a8c2bd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:54.791389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d000b105-1dfc-4a0b-9a1a-3201e0a8c2bd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:54.791841 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d000b105-1dfc-4a0b-9a1a-3201e0a8c2bd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:54.792602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d000b105-1dfc-4a0b-9a1a-3201e0a8c2bd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:54.793180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d000b105-1dfc-4a0b-9a1a-3201e0a8c2bd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:54.867862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d000b105-1dfc-4a0b-9a1a-3201e0a8c2bd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:54.875478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d000b105-1dfc-4a0b-9a1a-3201e0a8c2bd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1204 microversion: 2.1 time: 0.096255 Jun 02 16:10:54.876053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 266/519] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:54 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:55.156029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-430df4b2-b33a-40a9-a59a-acf10a2935e5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:55.156565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-430df4b2-b33a-40a9-a59a-acf10a2935e5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:55.165157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-430df4b2-b33a-40a9-a59a-acf10a2935e5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:55.165621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-430df4b2-b33a-40a9-a59a-acf10a2935e5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:55.167948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-430df4b2-b33a-40a9-a59a-acf10a2935e5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:55.168981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-430df4b2-b33a-40a9-a59a-acf10a2935e5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:55.198175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-430df4b2-b33a-40a9-a59a-acf10a2935e5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Going to try to terminate instance {{(pid=118257) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:10:55.500410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-903f50f9-744b-4456-bed7-eef0c2b77a8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:55.501088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-903f50f9-744b-4456-bed7-eef0c2b77a8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:55.507807 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-903f50f9-744b-4456-bed7-eef0c2b77a8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:55.508259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-903f50f9-744b-4456-bed7-eef0c2b77a8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:55.509033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-903f50f9-744b-4456-bed7-eef0c2b77a8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:55.509473 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-903f50f9-744b-4456-bed7-eef0c2b77a8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:55.526250 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-430df4b2-b33a-40a9-a59a-acf10a2935e5 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "DELETE /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 204 len: 0 microversion: 2.1 time: 0.374300 Jun 02 16:10:55.526901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 254/520] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:10:55 2022] DELETE /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:10:55.535599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-33edca91-6517-4939-ad3e-71ab968fa9dd tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:55.536308 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-33edca91-6517-4939-ad3e-71ab968fa9dd tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:55.542344 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33edca91-6517-4939-ad3e-71ab968fa9dd tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:55.543581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33edca91-6517-4939-ad3e-71ab968fa9dd tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:55.544669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33edca91-6517-4939-ad3e-71ab968fa9dd tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:55.545295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-33edca91-6517-4939-ad3e-71ab968fa9dd tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:55.683597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-33edca91-6517-4939-ad3e-71ab968fa9dd tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:55.691314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-33edca91-6517-4939-ad3e-71ab968fa9dd tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1503 microversion: 2.1 time: 0.159801 Jun 02 16:10:55.691890 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 255/521] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:55 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:55.714920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-903f50f9-744b-4456-bed7-eef0c2b77a8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:55.723954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-903f50f9-744b-4456-bed7-eef0c2b77a8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.228878 Jun 02 16:10:55.724505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 267/522] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:55 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:55.896498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f2e33dc5-ae76-4edc-bf43-f79a9b53cae2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:55.897186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f2e33dc5-ae76-4edc-bf43-f79a9b53cae2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:55.905355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2e33dc5-ae76-4edc-bf43-f79a9b53cae2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:55.906202 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2e33dc5-ae76-4edc-bf43-f79a9b53cae2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:55.907768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2e33dc5-ae76-4edc-bf43-f79a9b53cae2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:55.907768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2e33dc5-ae76-4edc-bf43-f79a9b53cae2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:56.047094 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f2e33dc5-ae76-4edc-bf43-f79a9b53cae2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:56.054875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f2e33dc5-ae76-4edc-bf43-f79a9b53cae2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1271 microversion: 2.1 time: 0.162392 Jun 02 16:10:56.055436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 256/523] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:55 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:56.171144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-dfc9f446-8b1a-4667-97cc-330c03329c28 req-469f9908-b064-464a-9dfa-1abd03409eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07acc928-a366-4e20-8462-b4e78a2a4e0b", "tag": "3b9de9f4-4fd1-4131-9b1c-81b197b00a5f"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:56.180652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-dfc9f446-8b1a-4667-97cc-330c03329c28 req-469f9908-b064-464a-9dfa-1abd03409eb5 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:56.181232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-dfc9f446-8b1a-4667-97cc-330c03329c28 req-469f9908-b064-464a-9dfa-1abd03409eb5 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:56.197906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-dfc9f446-8b1a-4667-97cc-330c03329c28 req-469f9908-b064-464a-9dfa-1abd03409eb5 service nova] Creating event network-changed:3b9de9f4-4fd1-4131-9b1c-81b197b00a5f for instance 07acc928-a366-4e20-8462-b4e78a2a4e0b on hv-cinder-79760 Jun 02 16:10:56.203641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-dfc9f446-8b1a-4667-97cc-330c03329c28 req-469f9908-b064-464a-9dfa-1abd03409eb5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036879 Jun 02 16:10:56.204249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 268/524] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:10:56.709312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d7a23851-b6cf-4bb7-aa47-8bb384ac8110 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:56.709922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d7a23851-b6cf-4bb7-aa47-8bb384ac8110 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:56.716895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7a23851-b6cf-4bb7-aa47-8bb384ac8110 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:56.717338 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7a23851-b6cf-4bb7-aa47-8bb384ac8110 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:56.718111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7a23851-b6cf-4bb7-aa47-8bb384ac8110 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:56.718547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7a23851-b6cf-4bb7-aa47-8bb384ac8110 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:56.741211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f6489ef6-e83f-4264-bccb-6d380167c5df tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:56.741929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f6489ef6-e83f-4264-bccb-6d380167c5df tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:56.748522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f6489ef6-e83f-4264-bccb-6d380167c5df tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:56.748968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f6489ef6-e83f-4264-bccb-6d380167c5df tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:56.749731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f6489ef6-e83f-4264-bccb-6d380167c5df tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:56.750191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f6489ef6-e83f-4264-bccb-6d380167c5df tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:56.855309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d7a23851-b6cf-4bb7-aa47-8bb384ac8110 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:56.862950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d7a23851-b6cf-4bb7-aa47-8bb384ac8110 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1503 microversion: 2.1 time: 0.157403 Jun 02 16:10:56.863523 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 257/525] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:56 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:56.889390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f6489ef6-e83f-4264-bccb-6d380167c5df tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:56.897524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f6489ef6-e83f-4264-bccb-6d380167c5df tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.160536 Jun 02 16:10:56.898038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 269/526] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:56 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:10:57.072709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bf80973d-0a1d-465f-bf4b-7b5627b553db tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:57.073369 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bf80973d-0a1d-465f-bf4b-7b5627b553db tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:57.079816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf80973d-0a1d-465f-bf4b-7b5627b553db tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:57.084893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf80973d-0a1d-465f-bf4b-7b5627b553db tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:57.084893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf80973d-0a1d-465f-bf4b-7b5627b553db tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:57.084893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf80973d-0a1d-465f-bf4b-7b5627b553db tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:57.084893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:57.216512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bf80973d-0a1d-465f-bf4b-7b5627b553db tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:57.224165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bf80973d-0a1d-465f-bf4b-7b5627b553db tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1271 microversion: 2.1 time: 0.155382 Jun 02 16:10:57.224743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 258/527] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:57 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:57.879972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e98cf512-2585-4118-8b2f-03247bdbcf52 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:57.880673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e98cf512-2585-4118-8b2f-03247bdbcf52 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:57.887431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98cf512-2585-4118-8b2f-03247bdbcf52 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:57.887973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98cf512-2585-4118-8b2f-03247bdbcf52 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:57.888845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98cf512-2585-4118-8b2f-03247bdbcf52 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:57.889368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98cf512-2585-4118-8b2f-03247bdbcf52 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:57.915471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4cfda29c-c9c6-4de2-996a-521d693d4b28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:57.916243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4cfda29c-c9c6-4de2-996a-521d693d4b28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:57.924291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4cfda29c-c9c6-4de2-996a-521d693d4b28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:57.924741 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4cfda29c-c9c6-4de2-996a-521d693d4b28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:57.925513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4cfda29c-c9c6-4de2-996a-521d693d4b28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:57.925953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4cfda29c-c9c6-4de2-996a-521d693d4b28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:58.062213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e98cf512-2585-4118-8b2f-03247bdbcf52 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:58.073016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e98cf512-2585-4118-8b2f-03247bdbcf52 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1503 microversion: 2.1 time: 0.196397 Jun 02 16:10:58.073682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 270/528] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:57 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:58.126961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-0008d82b-49b8-45a6-91c2-120615d67a2c req-0fddef08-9a6e-4a9d-b428-db58c4347f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821b1dbf-372d-4dc9-8365-97d4c5ba31a5", "name": "network-vif-deleted", "tag": "3c66c484-3019-4bf5-9d79-0403808ec4e9"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:10:58.134969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-0008d82b-49b8-45a6-91c2-120615d67a2c req-0fddef08-9a6e-4a9d-b428-db58c4347f97 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:58.135887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-0008d82b-49b8-45a6-91c2-120615d67a2c req-0fddef08-9a6e-4a9d-b428-db58c4347f97 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:58.147223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-0008d82b-49b8-45a6-91c2-120615d67a2c req-0fddef08-9a6e-4a9d-b428-db58c4347f97 service nova] Creating event network-vif-deleted:3c66c484-3019-4bf5-9d79-0403808ec4e9 for instance 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 on hv-cinder-79760 Jun 02 16:10:58.152627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4cfda29c-c9c6-4de2-996a-521d693d4b28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:58.152787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-0008d82b-49b8-45a6-91c2-120615d67a2c req-0fddef08-9a6e-4a9d-b428-db58c4347f97 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028898 Jun 02 16:10:58.153241 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 271/529] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:10:58.163819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4cfda29c-c9c6-4de2-996a-521d693d4b28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.249307 Jun 02 16:10:58.163819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 259/530] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:57 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:58.241634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9f1babb0-e4bd-469b-bc1f-227daf1a8395 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:58.242300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9f1babb0-e4bd-469b-bc1f-227daf1a8395 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:58.249005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f1babb0-e4bd-469b-bc1f-227daf1a8395 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:58.249454 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f1babb0-e4bd-469b-bc1f-227daf1a8395 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:58.250263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f1babb0-e4bd-469b-bc1f-227daf1a8395 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:58.250706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f1babb0-e4bd-469b-bc1f-227daf1a8395 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:58.385605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9f1babb0-e4bd-469b-bc1f-227daf1a8395 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:58.393035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9f1babb0-e4bd-469b-bc1f-227daf1a8395 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.155735 Jun 02 16:10:58.393596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 272/531] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:58 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:59.092362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2b84c4ee-45e9-475d-9f0f-772692e035f1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:59.092974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2b84c4ee-45e9-475d-9f0f-772692e035f1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:59.099504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b84c4ee-45e9-475d-9f0f-772692e035f1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:59.099955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b84c4ee-45e9-475d-9f0f-772692e035f1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:59.100721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b84c4ee-45e9-475d-9f0f-772692e035f1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:59.101160 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b84c4ee-45e9-475d-9f0f-772692e035f1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:59.163043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2b84c4ee-45e9-475d-9f0f-772692e035f1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:59.171551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2b84c4ee-45e9-475d-9f0f-772692e035f1 tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1299 microversion: 2.1 time: 0.083704 Jun 02 16:10:59.172494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 260/532] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:59 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:59.177732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-890a53b6-a2f2-4300-bfc5-651e6387b1c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:59.178381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-890a53b6-a2f2-4300-bfc5-651e6387b1c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:59.184960 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-890a53b6-a2f2-4300-bfc5-651e6387b1c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:59.185461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-890a53b6-a2f2-4300-bfc5-651e6387b1c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:59.186308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-890a53b6-a2f2-4300-bfc5-651e6387b1c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:59.186752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-890a53b6-a2f2-4300-bfc5-651e6387b1c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:59.315036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-890a53b6-a2f2-4300-bfc5-651e6387b1c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:59.322920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-890a53b6-a2f2-4300-bfc5-651e6387b1c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.148879 Jun 02 16:10:59.323565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 273/533] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:59 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:10:59.410418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ae1ffa45-3beb-4765-9163-c923a2323306 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:10:59.410945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ae1ffa45-3beb-4765-9163-c923a2323306 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:10:59.416891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ae1ffa45-3beb-4765-9163-c923a2323306 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:59.417331 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ae1ffa45-3beb-4765-9163-c923a2323306 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:59.418114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ae1ffa45-3beb-4765-9163-c923a2323306 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:10:59.418530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ae1ffa45-3beb-4765-9163-c923a2323306 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:10:59.550017 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ae1ffa45-3beb-4765-9163-c923a2323306 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:10:59.557442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ae1ffa45-3beb-4765-9163-c923a2323306 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.150926 Jun 02 16:10:59.558016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 261/534] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:10:59 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:00.188774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:00.189431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:00.195463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:00.195913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:00.196676 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:00.197113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:00.227770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:00.228216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:00.228752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lazy-loading 'fault' on Instance uuid 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:11:00.269263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1dbb393020e452fb78d212cf60a2a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b42e4a202a4942818fd25d0f25abe9de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:00.276493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7c9c3ebf-3015-48e2-951f-9376d237bccb tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 200 len: 1304 microversion: 2.1 time: 0.091645 Jun 02 16:11:00.277079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 274/535] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:00 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:00.342169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2aa90299-b01c-4b20-863d-45766603f7c0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:00.342700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2aa90299-b01c-4b20-863d-45766603f7c0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:00.344606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:00.350087 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2aa90299-b01c-4b20-863d-45766603f7c0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:00.350565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2aa90299-b01c-4b20-863d-45766603f7c0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:00.351315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2aa90299-b01c-4b20-863d-45766603f7c0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:00.351747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2aa90299-b01c-4b20-863d-45766603f7c0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:00.484173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2aa90299-b01c-4b20-863d-45766603f7c0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:00.493050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2aa90299-b01c-4b20-863d-45766603f7c0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.156272 Jun 02 16:11:00.493627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 262/536] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:00 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:00.574649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f5167839-0dd0-4e46-937f-4608a0dfbfd5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:00.575261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f5167839-0dd0-4e46-937f-4608a0dfbfd5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:00.581406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5167839-0dd0-4e46-937f-4608a0dfbfd5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:00.581857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5167839-0dd0-4e46-937f-4608a0dfbfd5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:00.583249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5167839-0dd0-4e46-937f-4608a0dfbfd5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:00.583691 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5167839-0dd0-4e46-937f-4608a0dfbfd5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:00.716217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f5167839-0dd0-4e46-937f-4608a0dfbfd5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:00.723507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f5167839-0dd0-4e46-937f-4608a0dfbfd5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.153390 Jun 02 16:11:00.724056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 275/537] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:00 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:01.293975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:01.294634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] [instance: 821b1dbf-372d-4dc9-8365-97d4c5ba31a5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:01.300596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:01.301035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:01.301783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:01.302255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:01.315305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] HTTP exception thrown: Instance 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 could not be found. Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Request method failure captured: Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 HTTP/1.1 Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimODYHjKVCgN7WPlUjSeEtvFLyuyW2cfwjKWijYOyZrSJFyjMHEkhx2LSvUVDff_jTSyIqmmQIVgEPH6UVLknTUtn0DuSyAtNY6jcZcu1Wy_BxdQUy5CPjTRsXhkvxuVCwRroGT-Q975yWp7yP-f_lI_RuXLDOKRIZPHoCSacsn1TGIE Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: b42e4a202a4942818fd25d0f25abe9de Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-VolumesActionsTest-700176584 Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:11:01.316909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b42e4a202a4942818fd25d0f25abe9de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b42e4a202a4942818fd25d0f25abe9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b42e4a202a4942818fd25d0f25abe9de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b42e4a202a4942818fd25d0f25abe9de"}]}] Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-VolumesActionsTest-700176584 Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: b42e4a202a4942818fd25d0f25abe9de Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-VolumesActionsTest-700176584 Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-VolumesActionsTest-700176584-project Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: e1dbb393020e452fb78d212cf60a2a72 Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-VolumesActionsTest-700176584-project Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 could not be found. Jun 02 16:11:01.318466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '821b1dbf-372d-4dc9-8365-97d4c5ba31a5'} Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 could not be found. Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:11:01.319291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 could not be found. Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 could not be found. Jun 02 16:11:01.320530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:11:01.321612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] Returning 404 to user: Instance 821b1dbf-372d-4dc9-8365-97d4c5ba31a5 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:11:01.321612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-230ee39c-4c8a-4b1e-b5a7-99660124096b tempest-VolumesActionsTest-700176584 tempest-VolumesActionsTest-700176584-project] 10.222.0.59 "GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5" status: 404 len: 111 microversion: 2.1 time: 0.028783 Jun 02 16:11:01.321612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 263/538] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:01 2022] GET /compute/v2.1/servers/821b1dbf-372d-4dc9-8365-97d4c5ba31a5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:11:01.510658 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5ae8535a-2c40-4eff-af34-c10e7558a98a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:01.511275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5ae8535a-2c40-4eff-af34-c10e7558a98a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:01.518356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ae8535a-2c40-4eff-af34-c10e7558a98a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:01.518823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ae8535a-2c40-4eff-af34-c10e7558a98a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:01.519594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ae8535a-2c40-4eff-af34-c10e7558a98a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:01.520050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ae8535a-2c40-4eff-af34-c10e7558a98a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:01.650980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5ae8535a-2c40-4eff-af34-c10e7558a98a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:01.660068 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5ae8535a-2c40-4eff-af34-c10e7558a98a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1722 microversion: 2.1 time: 0.153395 Jun 02 16:11:01.660637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 276/539] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:01 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:01.740504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-db4a044a-21eb-4321-a6a5-8de794b6dad4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:01.741123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-db4a044a-21eb-4321-a6a5-8de794b6dad4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:01.743535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=10 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:01.748704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db4a044a-21eb-4321-a6a5-8de794b6dad4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:01.749160 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db4a044a-21eb-4321-a6a5-8de794b6dad4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:01.749933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db4a044a-21eb-4321-a6a5-8de794b6dad4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:01.750474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db4a044a-21eb-4321-a6a5-8de794b6dad4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:01.890411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-db4a044a-21eb-4321-a6a5-8de794b6dad4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:01.898405 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-db4a044a-21eb-4321-a6a5-8de794b6dad4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.161609 Jun 02 16:11:01.904414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 264/540] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:01 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:02.677190 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5b31902e-0e91-4344-a49a-d0135d6bc7a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:02.678021 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5b31902e-0e91-4344-a49a-d0135d6bc7a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:02.686087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b31902e-0e91-4344-a49a-d0135d6bc7a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:02.686555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b31902e-0e91-4344-a49a-d0135d6bc7a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:02.687329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b31902e-0e91-4344-a49a-d0135d6bc7a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:02.687764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b31902e-0e91-4344-a49a-d0135d6bc7a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:02.822694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5b31902e-0e91-4344-a49a-d0135d6bc7a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:02.832490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5b31902e-0e91-4344-a49a-d0135d6bc7a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1699 microversion: 2.1 time: 0.159407 Jun 02 16:11:02.833275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 277/541] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:02 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:02.852385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8ca5c3ee-52db-41a8-8f4c-ec93471d2285 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:11:02.857943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ca5c3ee-52db-41a8-8f4c-ec93471d2285 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:02.858438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ca5c3ee-52db-41a8-8f4c-ec93471d2285 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:02.915655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a9d465da-a829-43bd-8a39-2ae3eba4cc44 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:02.916446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a9d465da-a829-43bd-8a39-2ae3eba4cc44 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:02.922042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8ca5c3ee-52db-41a8-8f4c-ec93471d2285 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Going to try to start instance {{(pid=118257) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 16:11:02.923242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a9d465da-a829-43bd-8a39-2ae3eba4cc44 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:02.923760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a9d465da-a829-43bd-8a39-2ae3eba4cc44 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:02.924630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a9d465da-a829-43bd-8a39-2ae3eba4cc44 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:02.925136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a9d465da-a829-43bd-8a39-2ae3eba4cc44 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:03.063314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a9d465da-a829-43bd-8a39-2ae3eba4cc44 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:03.070650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a9d465da-a829-43bd-8a39-2ae3eba4cc44 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.158949 Jun 02 16:11:03.071214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 278/542] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:02 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:11:03.266949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8ca5c3ee-52db-41a8-8f4c-ec93471d2285 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/action" status: 202 len: 0 microversion: 2.1 time: 0.420446 Jun 02 16:11:03.267554 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 265/543] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:11:02 2022] POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:11:03.275667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-543f913e-5c96-4d29-bd96-9cf3fa6ebb64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:03.276302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-543f913e-5c96-4d29-bd96-9cf3fa6ebb64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:03.282731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-543f913e-5c96-4d29-bd96-9cf3fa6ebb64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:03.288064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-543f913e-5c96-4d29-bd96-9cf3fa6ebb64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:03.288064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-543f913e-5c96-4d29-bd96-9cf3fa6ebb64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:03.288064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-543f913e-5c96-4d29-bd96-9cf3fa6ebb64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:03.415716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-543f913e-5c96-4d29-bd96-9cf3fa6ebb64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:03.425137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-543f913e-5c96-4d29-bd96-9cf3fa6ebb64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1708 microversion: 2.1 time: 0.153281 Jun 02 16:11:03.425891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 279/544] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:03 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:04.090272 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-473a21a2-e72b-460c-8bd0-98969f28c4ad tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:04.091204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-473a21a2-e72b-460c-8bd0-98969f28c4ad tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:04.098148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-473a21a2-e72b-460c-8bd0-98969f28c4ad tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:04.098596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-473a21a2-e72b-460c-8bd0-98969f28c4ad tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:04.099347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-473a21a2-e72b-460c-8bd0-98969f28c4ad tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:04.099774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-473a21a2-e72b-460c-8bd0-98969f28c4ad tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:04.237354 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-473a21a2-e72b-460c-8bd0-98969f28c4ad tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:04.245403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-473a21a2-e72b-460c-8bd0-98969f28c4ad tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.159932 Jun 02 16:11:04.246712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 266/545] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:04 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:04.442637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d80c5f3d-c527-4d70-bf03-3d8e2e348718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:04.443831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d80c5f3d-c527-4d70-bf03-3d8e2e348718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:04.451311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d80c5f3d-c527-4d70-bf03-3d8e2e348718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:04.451857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d80c5f3d-c527-4d70-bf03-3d8e2e348718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:04.453441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d80c5f3d-c527-4d70-bf03-3d8e2e348718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:04.453887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d80c5f3d-c527-4d70-bf03-3d8e2e348718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:04.587236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d80c5f3d-c527-4d70-bf03-3d8e2e348718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:04.596213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d80c5f3d-c527-4d70-bf03-3d8e2e348718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1708 microversion: 2.1 time: 0.157376 Jun 02 16:11:04.596769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 280/546] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:04 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:05.264054 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b120f8c3-2cf3-46de-b975-37909ab90afc tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:05.264660 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b120f8c3-2cf3-46de-b975-37909ab90afc tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:05.271327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b120f8c3-2cf3-46de-b975-37909ab90afc tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:05.271767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b120f8c3-2cf3-46de-b975-37909ab90afc tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:05.272520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b120f8c3-2cf3-46de-b975-37909ab90afc tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:05.272949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b120f8c3-2cf3-46de-b975-37909ab90afc tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:05.403802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b120f8c3-2cf3-46de-b975-37909ab90afc tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:05.411373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b120f8c3-2cf3-46de-b975-37909ab90afc tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.151650 Jun 02 16:11:05.418751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 267/547] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:05 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:05.616310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8fc2356f-9031-402f-afc5-6ab9a01bec8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:05.616835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8fc2356f-9031-402f-afc5-6ab9a01bec8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:05.623611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fc2356f-9031-402f-afc5-6ab9a01bec8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:05.624061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fc2356f-9031-402f-afc5-6ab9a01bec8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:05.624817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fc2356f-9031-402f-afc5-6ab9a01bec8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:05.625246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fc2356f-9031-402f-afc5-6ab9a01bec8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:05.753944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8fc2356f-9031-402f-afc5-6ab9a01bec8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:05.762190 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8fc2356f-9031-402f-afc5-6ab9a01bec8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1708 microversion: 2.1 time: 0.149963 Jun 02 16:11:05.763345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 281/548] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:05 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:06.428782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-016c71e7-14b8-4781-9134-051a907b9356 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:06.429330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-016c71e7-14b8-4781-9134-051a907b9356 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:06.435942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-016c71e7-14b8-4781-9134-051a907b9356 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:06.436395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-016c71e7-14b8-4781-9134-051a907b9356 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:06.437139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-016c71e7-14b8-4781-9134-051a907b9356 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:06.437570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-016c71e7-14b8-4781-9134-051a907b9356 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:06.571384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-016c71e7-14b8-4781-9134-051a907b9356 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:06.578954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-016c71e7-14b8-4781-9134-051a907b9356 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.154120 Jun 02 16:11:06.579531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 268/549] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:06 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:06.782184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-735a8b4a-cf25-48b4-9a9d-7537705929d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:06.782775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-735a8b4a-cf25-48b4-9a9d-7537705929d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:06.789028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-735a8b4a-cf25-48b4-9a9d-7537705929d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:06.789476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-735a8b4a-cf25-48b4-9a9d-7537705929d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:06.790275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-735a8b4a-cf25-48b4-9a9d-7537705929d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:06.790714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-735a8b4a-cf25-48b4-9a9d-7537705929d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:06.930612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-735a8b4a-cf25-48b4-9a9d-7537705929d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:06.939461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-735a8b4a-cf25-48b4-9a9d-7537705929d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1708 microversion: 2.1 time: 0.162207 Jun 02 16:11:06.940024 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 282/550] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:06 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:07.597073 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5e15d6e3-2afb-480a-b680-a3d87114776a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:07.597853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5e15d6e3-2afb-480a-b680-a3d87114776a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:07.604511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5e15d6e3-2afb-480a-b680-a3d87114776a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:07.605046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5e15d6e3-2afb-480a-b680-a3d87114776a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:07.605819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5e15d6e3-2afb-480a-b680-a3d87114776a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:07.606299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5e15d6e3-2afb-480a-b680-a3d87114776a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:07.741837 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5e15d6e3-2afb-480a-b680-a3d87114776a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:07.749194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5e15d6e3-2afb-480a-b680-a3d87114776a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.156004 Jun 02 16:11:07.749755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 269/551] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:07 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:07.956909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4c729eda-4b1a-426c-98a1-063d2fb8d9b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:07.957733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4c729eda-4b1a-426c-98a1-063d2fb8d9b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:07.963852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c729eda-4b1a-426c-98a1-063d2fb8d9b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:07.964356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c729eda-4b1a-426c-98a1-063d2fb8d9b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:07.965278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c729eda-4b1a-426c-98a1-063d2fb8d9b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:07.965713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c729eda-4b1a-426c-98a1-063d2fb8d9b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:07.970487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:08.098639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4c729eda-4b1a-426c-98a1-063d2fb8d9b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:08.108016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4c729eda-4b1a-426c-98a1-063d2fb8d9b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1708 microversion: 2.1 time: 0.155272 Jun 02 16:11:08.108594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 283/552] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:07 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:08.766483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cdf2a40b-42c9-4a7b-81fc-2e05d702bf73 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:08.767087 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cdf2a40b-42c9-4a7b-81fc-2e05d702bf73 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:08.773477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdf2a40b-42c9-4a7b-81fc-2e05d702bf73 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:08.773919 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdf2a40b-42c9-4a7b-81fc-2e05d702bf73 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:08.774717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdf2a40b-42c9-4a7b-81fc-2e05d702bf73 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:08.775146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdf2a40b-42c9-4a7b-81fc-2e05d702bf73 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:08.921763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cdf2a40b-42c9-4a7b-81fc-2e05d702bf73 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:08.929124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cdf2a40b-42c9-4a7b-81fc-2e05d702bf73 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.166431 Jun 02 16:11:08.929693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 270/553] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:08 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:09.125470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6bd3f659-40a2-4754-b389-a99b2c496069 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:09.126103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6bd3f659-40a2-4754-b389-a99b2c496069 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:09.127984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=78 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:09.132956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6bd3f659-40a2-4754-b389-a99b2c496069 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:09.133410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6bd3f659-40a2-4754-b389-a99b2c496069 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:09.134208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6bd3f659-40a2-4754-b389-a99b2c496069 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:09.134651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6bd3f659-40a2-4754-b389-a99b2c496069 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:09.282033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6bd3f659-40a2-4754-b389-a99b2c496069 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:09.291295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6bd3f659-40a2-4754-b389-a99b2c496069 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1708 microversion: 2.1 time: 0.170555 Jun 02 16:11:09.291867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 284/554] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:09 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1708 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:09.946819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0b77d153-cdfe-4310-ac12-e2d0b9b84e05 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:09.948649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0b77d153-cdfe-4310-ac12-e2d0b9b84e05 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:09.956149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b77d153-cdfe-4310-ac12-e2d0b9b84e05 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:09.957270 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b77d153-cdfe-4310-ac12-e2d0b9b84e05 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:09.958525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b77d153-cdfe-4310-ac12-e2d0b9b84e05 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:09.959293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b77d153-cdfe-4310-ac12-e2d0b9b84e05 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:10.127764 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0b77d153-cdfe-4310-ac12-e2d0b9b84e05 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:10.137451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0b77d153-cdfe-4310-ac12-e2d0b9b84e05 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.193670 Jun 02 16:11:10.138439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 271/555] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:09 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:10.309734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-24e7e3bc-9202-49f5-ad49-7bc8c081008c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:10.312344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-24e7e3bc-9202-49f5-ad49-7bc8c081008c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:10.319523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24e7e3bc-9202-49f5-ad49-7bc8c081008c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:10.320230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24e7e3bc-9202-49f5-ad49-7bc8c081008c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:10.321532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24e7e3bc-9202-49f5-ad49-7bc8c081008c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:10.322091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24e7e3bc-9202-49f5-ad49-7bc8c081008c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:10.506576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-24e7e3bc-9202-49f5-ad49-7bc8c081008c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:10.523312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-24e7e3bc-9202-49f5-ad49-7bc8c081008c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1708 microversion: 2.1 time: 0.212908 Jun 02 16:11:10.523927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 285/556] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:10 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1708 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:11.158677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4d367b15-55e6-46cd-99b3-7e69c7722ee3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:11.160996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4d367b15-55e6-46cd-99b3-7e69c7722ee3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:11.174440 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d367b15-55e6-46cd-99b3-7e69c7722ee3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:11.176167 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d367b15-55e6-46cd-99b3-7e69c7722ee3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:11.177754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d367b15-55e6-46cd-99b3-7e69c7722ee3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:11.178908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d367b15-55e6-46cd-99b3-7e69c7722ee3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:11.359015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4d367b15-55e6-46cd-99b3-7e69c7722ee3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:11.368288 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4d367b15-55e6-46cd-99b3-7e69c7722ee3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.214211 Jun 02 16:11:11.368983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 272/557] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:11 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:11.544022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-801e7586-ce59-4b97-b553-cb49840bdaa2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:11.544637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-801e7586-ce59-4b97-b553-cb49840bdaa2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:11.550664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-801e7586-ce59-4b97-b553-cb49840bdaa2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:11.553943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-801e7586-ce59-4b97-b553-cb49840bdaa2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:11.554933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-801e7586-ce59-4b97-b553-cb49840bdaa2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:11.555419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-801e7586-ce59-4b97-b553-cb49840bdaa2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:11.703864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-801e7586-ce59-4b97-b553-cb49840bdaa2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:11.715854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-801e7586-ce59-4b97-b553-cb49840bdaa2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1712 microversion: 2.1 time: 0.176743 Jun 02 16:11:11.716890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 286/558] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:11 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1712 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:12.387229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3283b454-6a76-4ba6-a517-4e939e36c959 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:12.387814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3283b454-6a76-4ba6-a517-4e939e36c959 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:12.394874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3283b454-6a76-4ba6-a517-4e939e36c959 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:12.395374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3283b454-6a76-4ba6-a517-4e939e36c959 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:12.396258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3283b454-6a76-4ba6-a517-4e939e36c959 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:12.396745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3283b454-6a76-4ba6-a517-4e939e36c959 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:12.776195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3283b454-6a76-4ba6-a517-4e939e36c959 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:12.783665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3283b454-6a76-4ba6-a517-4e939e36c959 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.401057 Jun 02 16:11:12.784234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 273/559] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:12 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:13.148743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-8196a3ae-7822-4211-ba23-07151a6e7953 req-9a783972-0a6b-4520-a756-64586c284e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07acc928-a366-4e20-8462-b4e78a2a4e0b", "name": "network-vif-plugged", "status": "completed", "tag": "3b9de9f4-4fd1-4131-9b1c-81b197b00a5f"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:11:13.165287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-8196a3ae-7822-4211-ba23-07151a6e7953 req-9a783972-0a6b-4520-a756-64586c284e79 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:13.165977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-8196a3ae-7822-4211-ba23-07151a6e7953 req-9a783972-0a6b-4520-a756-64586c284e79 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:13.185481 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-8196a3ae-7822-4211-ba23-07151a6e7953 req-9a783972-0a6b-4520-a756-64586c284e79 service nova] Creating event network-vif-plugged:3b9de9f4-4fd1-4131-9b1c-81b197b00a5f for instance 07acc928-a366-4e20-8462-b4e78a2a4e0b on hv-cinder-79760 Jun 02 16:11:13.191947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-8196a3ae-7822-4211-ba23-07151a6e7953 req-9a783972-0a6b-4520-a756-64586c284e79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046920 Jun 02 16:11:13.193363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 287/560] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:11:13.582159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-07cc31da-4243-4457-91ac-766aa99ca5b3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:13.582892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-07cc31da-4243-4457-91ac-766aa99ca5b3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:13.589297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07cc31da-4243-4457-91ac-766aa99ca5b3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:13.589986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07cc31da-4243-4457-91ac-766aa99ca5b3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:13.591012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07cc31da-4243-4457-91ac-766aa99ca5b3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:13.591986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07cc31da-4243-4457-91ac-766aa99ca5b3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:13.607356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:13.619429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-07cc31da-4243-4457-91ac-766aa99ca5b3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/ips" status: 200 len: 153 microversion: 2.20 time: 0.040344 Jun 02 16:11:13.620495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 274/561] 10.222.0.59 () {60 vars in 1288 bytes} [Thu Jun 2 16:11:13 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:11:13.806442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c90fb689-edf4-4fa8-8072-0ae673ecc734 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:13.809102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c90fb689-edf4-4fa8-8072-0ae673ecc734 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:13.820560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c90fb689-edf4-4fa8-8072-0ae673ecc734 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:13.826301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c90fb689-edf4-4fa8-8072-0ae673ecc734 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:13.826301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c90fb689-edf4-4fa8-8072-0ae673ecc734 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:13.826301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c90fb689-edf4-4fa8-8072-0ae673ecc734 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:14.013755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c90fb689-edf4-4fa8-8072-0ae673ecc734 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:14.022753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c90fb689-edf4-4fa8-8072-0ae673ecc734 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.224762 Jun 02 16:11:14.023893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 288/562] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:13 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:15.040658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b5d618a1-a20c-48aa-932f-f21fc82649d6 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:15.041230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b5d618a1-a20c-48aa-932f-f21fc82649d6 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:15.048559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5d618a1-a20c-48aa-932f-f21fc82649d6 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:15.049014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5d618a1-a20c-48aa-932f-f21fc82649d6 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:15.049837 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5d618a1-a20c-48aa-932f-f21fc82649d6 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:15.050314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5d618a1-a20c-48aa-932f-f21fc82649d6 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:15.196693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b5d618a1-a20c-48aa-932f-f21fc82649d6 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:15.205846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b5d618a1-a20c-48aa-932f-f21fc82649d6 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.169077 Jun 02 16:11:15.215466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 275/563] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:15 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:16.222852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-86d1e648-2551-4439-a577-0e7801dad7d8 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:16.223803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-86d1e648-2551-4439-a577-0e7801dad7d8 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:16.229656 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86d1e648-2551-4439-a577-0e7801dad7d8 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:16.231222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86d1e648-2551-4439-a577-0e7801dad7d8 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:16.232027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86d1e648-2551-4439-a577-0e7801dad7d8 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:16.232692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86d1e648-2551-4439-a577-0e7801dad7d8 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:16.387769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-86d1e648-2551-4439-a577-0e7801dad7d8 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:16.396303 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-86d1e648-2551-4439-a577-0e7801dad7d8 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1259 microversion: 2.1 time: 0.177345 Jun 02 16:11:16.396779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 289/564] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:16 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:17.136883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9256e22c-737e-474b-b395-2cb607b16da8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:11:17.138005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9256e22c-737e-474b-b395-2cb607b16da8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:17.147376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9256e22c-737e-474b-b395-2cb607b16da8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:17.148136 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9256e22c-737e-474b-b395-2cb607b16da8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:17.149314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9256e22c-737e-474b-b395-2cb607b16da8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:17.149814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9256e22c-737e-474b-b395-2cb607b16da8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:17.182564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-9256e22c-737e-474b-b395-2cb607b16da8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lazy-loading 'flavor' on Instance uuid f8bf99ae-5d36-4add-b49f-746e933e19cc {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:11:17.414675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5dc4fd76-7e07-4001-88c3-06d9cc655ebd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:17.416575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5dc4fd76-7e07-4001-88c3-06d9cc655ebd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:17.424814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5dc4fd76-7e07-4001-88c3-06d9cc655ebd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:17.426108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5dc4fd76-7e07-4001-88c3-06d9cc655ebd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:17.427541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5dc4fd76-7e07-4001-88c3-06d9cc655ebd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:17.428155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5dc4fd76-7e07-4001-88c3-06d9cc655ebd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:17.596647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5dc4fd76-7e07-4001-88c3-06d9cc655ebd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:17.607479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5dc4fd76-7e07-4001-88c3-06d9cc655ebd tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1444 microversion: 2.1 time: 0.198001 Jun 02 16:11:17.608311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 290/565] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:17 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1444 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:17.632841 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3a6d5705-2d76-48ef-bdb9-c7434705fa2e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:17.633463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3a6d5705-2d76-48ef-bdb9-c7434705fa2e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:17.641615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a6d5705-2d76-48ef-bdb9-c7434705fa2e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:17.642129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a6d5705-2d76-48ef-bdb9-c7434705fa2e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:17.642967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a6d5705-2d76-48ef-bdb9-c7434705fa2e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:17.643456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a6d5705-2d76-48ef-bdb9-c7434705fa2e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:17.805495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9256e22c-737e-474b-b395-2cb607b16da8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/action" status: 202 len: 0 microversion: 2.20 time: 0.673598 Jun 02 16:11:17.806503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 276/566] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jun 2 16:11:17 2022] POST /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:11:17.816158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:17.817167 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:17.825128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3a6d5705-2d76-48ef-bdb9-c7434705fa2e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:17.836436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3a6d5705-2d76-48ef-bdb9-c7434705fa2e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1444 microversion: 2.1 time: 0.207947 Jun 02 16:11:17.837482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 291/567] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:17 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1444 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:17.838928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:17.840173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:17.841453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:17.841902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:18.075144 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:18.084387 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:18.088667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:18.097059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cfa7c9b0-4d6c-40c9-beba-d72c4867aee8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.286145 Jun 02 16:11:18.098007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 277/568] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:17 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:11:19.116627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:19.117200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:19.123277 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:19.123731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:19.124503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:19.124942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:19.284231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:19.293838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:19.295759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:19.297442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5cc5e248-5790-45a9-9c22-23da43e95b60 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.184722 Jun 02 16:11:19.298574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 292/569] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:19 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:20.326879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:20.327592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:20.338433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:20.343071 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:20.344308 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:20.345121 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:20.345828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:20.498953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-6cbc56dc-bb62-4d6a-a051-7e92142f806f req-e29864fd-2276-4b73-a968-6fa41038c807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07acc928-a366-4e20-8462-b4e78a2a4e0b", "tag": "3b9de9f4-4fd1-4131-9b1c-81b197b00a5f"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:11:20.511878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-6cbc56dc-bb62-4d6a-a051-7e92142f806f req-e29864fd-2276-4b73-a968-6fa41038c807 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:20.512637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-6cbc56dc-bb62-4d6a-a051-7e92142f806f req-e29864fd-2276-4b73-a968-6fa41038c807 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:20.524759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-6cbc56dc-bb62-4d6a-a051-7e92142f806f req-e29864fd-2276-4b73-a968-6fa41038c807 service nova] Creating event network-changed:3b9de9f4-4fd1-4131-9b1c-81b197b00a5f for instance 07acc928-a366-4e20-8462-b4e78a2a4e0b on hv-cinder-79760 Jun 02 16:11:20.531314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-6cbc56dc-bb62-4d6a-a051-7e92142f806f req-e29864fd-2276-4b73-a968-6fa41038c807 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036522 Jun 02 16:11:20.532534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 293/570] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:11:20.572670 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:20.589868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:20.593022 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:20.594978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5f6a477d-a61a-45fb-90ba-0d027b2f1f27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.277097 Jun 02 16:11:20.608287 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 278/571] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:20 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:21.615230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:21.616510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:21.623043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:21.623759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:21.624672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:21.625255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:21.793648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:21.805127 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:21.806873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:21.808085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9f3236a7-3327-44d8-8121-64400bf33212 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.199121 Jun 02 16:11:21.808883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 294/572] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:21 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:22.829060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:22.830352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:22.842974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:22.843593 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:22.845242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:22.846017 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:22.994806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:23.003992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:23.005527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:23.006789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b76c9b2b-3f3f-4775-b7c0-ecefcbc89939 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.184048 Jun 02 16:11:23.007255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 279/573] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:22 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:24.025763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:24.027060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:24.033253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:24.033706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:24.034529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:24.034965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:24.179078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:24.192996 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:24.195759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:24.196984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1282b9f2-df7d-419a-8452-671f8ed704c2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.175128 Jun 02 16:11:24.197538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 295/574] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:24 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:11:25.216654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:25.217466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:25.224958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:25.225402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:25.226216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:25.226651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:25.462334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:25.470779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:25.472448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:25.473630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f54fcb4b-990d-4446-ac40-8f9c46fcc224 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.261707 Jun 02 16:11:25.474211 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 280/575] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:25 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:26.491374 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:26.491987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:26.498345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:26.498798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:26.499559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:26.499997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:26.633026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:26.641686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:26.643277 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:26.644394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-697655cc-dad1-419f-8f5f-8801d9d14940 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.156940 Jun 02 16:11:26.644962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 296/576] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:26 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:27.685340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:27.685340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:27.685340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:27.685340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:27.687294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:27.687294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:27.908974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:27.917110 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:27.918577 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:27.919716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9d033ccd-4de8-4781-ba20-0839a80626d4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.261162 Jun 02 16:11:27.920267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 281/577] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:27 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:28.938193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:28.938803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:28.944772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:28.945227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:28.945976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:28.946488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:29.126784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:29.134625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:29.136868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:29.138269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-36d2ce53-1a4b-49dd-810d-1767d9090a6b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.203906 Jun 02 16:11:29.138823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 297/578] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:28 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:30.158714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:30.159363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:30.165459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:30.165914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:30.166742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:30.167787 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:30.307970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:30.316232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:30.317743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:30.318927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e9c6a19a-5c83-47e9-9c74-ddec0a8e53a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.164909 Jun 02 16:11:30.319493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 282/579] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:30 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:31.337938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:31.338582 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:31.345513 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:31.346010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:31.346860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:31.347299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:31.459573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c2b968f6-bff4-4e43-bfe5-63184d3e284f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:11:31.460721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c2b968f6-bff4-4e43-bfe5-63184d3e284f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:31.468408 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c2b968f6-bff4-4e43-bfe5-63184d3e284f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:31.468962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c2b968f6-bff4-4e43-bfe5-63184d3e284f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:31.469688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c2b968f6-bff4-4e43-bfe5-63184d3e284f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:31.470179 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c2b968f6-bff4-4e43-bfe5-63184d3e284f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:31.480984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:31.489755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:31.494619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:31.494619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-678ab8b1-998f-4fa4-bb32-c0bf282c361e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.158611 Jun 02 16:11:31.494619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 298/580] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:31 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:31.836179 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c2b968f6-bff4-4e43-bfe5-63184d3e284f tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "POST /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/action" status: 202 len: 0 microversion: 2.1 time: 0.380403 Jun 02 16:11:31.837139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 283/581] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:11:31 2022] POST /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 16:11:31.845898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d8cd6d95-38f8-4958-b04f-8cd64d2ecdf9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:31.846661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d8cd6d95-38f8-4958-b04f-8cd64d2ecdf9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:31.852874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d8cd6d95-38f8-4958-b04f-8cd64d2ecdf9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:31.853316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d8cd6d95-38f8-4958-b04f-8cd64d2ecdf9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:31.854141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d8cd6d95-38f8-4958-b04f-8cd64d2ecdf9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:31.854623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d8cd6d95-38f8-4958-b04f-8cd64d2ecdf9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:32.049571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d8cd6d95-38f8-4958-b04f-8cd64d2ecdf9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:32.058810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d8cd6d95-38f8-4958-b04f-8cd64d2ecdf9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1752 microversion: 2.1 time: 0.216862 Jun 02 16:11:32.059395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 299/582] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:31 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:11:32.511570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:32.512305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:32.518902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:32.519349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:32.520109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:32.520544 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:32.705664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:32.714660 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:32.717166 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:32.718675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-985d3f6e-6901-4a0f-8449-059c9e5e71a9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.211287 Jun 02 16:11:32.719238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 284/583] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:32 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:33.078325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b0c9388e-03c2-47a6-b2f5-5765c010ede0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:33.079158 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b0c9388e-03c2-47a6-b2f5-5765c010ede0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:33.085694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0c9388e-03c2-47a6-b2f5-5765c010ede0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:33.086202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0c9388e-03c2-47a6-b2f5-5765c010ede0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:33.086991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0c9388e-03c2-47a6-b2f5-5765c010ede0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:33.087429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0c9388e-03c2-47a6-b2f5-5765c010ede0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:33.249290 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b0c9388e-03c2-47a6-b2f5-5765c010ede0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:33.257854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b0c9388e-03c2-47a6-b2f5-5765c010ede0 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1752 microversion: 2.1 time: 0.185235 Jun 02 16:11:33.258461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 300/584] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:33 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:33.738529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:33.739134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:33.745974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:33.746610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:33.748786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:33.748786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:33.884426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:33.892947 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:33.894502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:33.895649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4e6d2e85-211e-4c9b-9d33-b8e84af5a843 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.160951 Jun 02 16:11:33.896208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 285/585] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:33 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:34.275910 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c7085099-5ea7-4e56-a416-e6d3cf2a071e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:34.277054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c7085099-5ea7-4e56-a416-e6d3cf2a071e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:34.283126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7085099-5ea7-4e56-a416-e6d3cf2a071e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:34.283630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7085099-5ea7-4e56-a416-e6d3cf2a071e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:34.284343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7085099-5ea7-4e56-a416-e6d3cf2a071e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:34.284778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7085099-5ea7-4e56-a416-e6d3cf2a071e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:34.287475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:34.434829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c7085099-5ea7-4e56-a416-e6d3cf2a071e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:34.442904 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c7085099-5ea7-4e56-a416-e6d3cf2a071e tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.170889 Jun 02 16:11:34.443463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 301/586] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:34 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:34.914472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:34.915004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:34.922026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:34.922512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:34.923281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:34.923722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:35.052038 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:35.060420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:35.061934 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:35.063119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5b780b0c-98ba-458d-9068-07f3c241276f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1742 microversion: 2.20 time: 0.152757 Jun 02 16:11:35.063686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 286/587] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:34 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:35.460415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fa70f92b-7ef5-4dea-97db-bd2c254b2658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:35.461028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fa70f92b-7ef5-4dea-97db-bd2c254b2658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:35.467885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa70f92b-7ef5-4dea-97db-bd2c254b2658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:35.468335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa70f92b-7ef5-4dea-97db-bd2c254b2658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:35.469142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa70f92b-7ef5-4dea-97db-bd2c254b2658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:35.469581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa70f92b-7ef5-4dea-97db-bd2c254b2658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:35.612383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fa70f92b-7ef5-4dea-97db-bd2c254b2658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:35.620730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fa70f92b-7ef5-4dea-97db-bd2c254b2658 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.164195 Jun 02 16:11:35.621290 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 302/588] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:35 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:36.081655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:36.082327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:36.089220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:36.089610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:36.090413 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:36.090891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:36.220248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:36.228152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:36.230138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:36.231337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1b2e1edb-ca50-4f3b-bcfc-4e5a2e67b52e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1742 microversion: 2.20 time: 0.153639 Jun 02 16:11:36.231902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 287/589] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:36 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:36.638427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b49a416a-7a04-4a1a-8999-96bcb628cab8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:36.639041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b49a416a-7a04-4a1a-8999-96bcb628cab8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:36.645045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b49a416a-7a04-4a1a-8999-96bcb628cab8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:36.645491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b49a416a-7a04-4a1a-8999-96bcb628cab8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:36.646284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b49a416a-7a04-4a1a-8999-96bcb628cab8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:36.646722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b49a416a-7a04-4a1a-8999-96bcb628cab8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:36.790228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b49a416a-7a04-4a1a-8999-96bcb628cab8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:36.798917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b49a416a-7a04-4a1a-8999-96bcb628cab8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.165072 Jun 02 16:11:36.799479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 303/590] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:36 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:37.249537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:37.250175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:37.256553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:37.256992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:37.257748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:37.258201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:37.273044 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:37.393519 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:37.401930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:37.403478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:37.404678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1dae152d-bb0e-495f-acd9-e01decf57990 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1742 microversion: 2.20 time: 0.159035 Jun 02 16:11:37.405246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 288/591] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:37 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:37.817565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ac6491c1-8aa0-41c8-8ee5-561111045619 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:37.818363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ac6491c1-8aa0-41c8-8ee5-561111045619 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:37.825715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac6491c1-8aa0-41c8-8ee5-561111045619 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:37.826169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac6491c1-8aa0-41c8-8ee5-561111045619 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:37.826954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac6491c1-8aa0-41c8-8ee5-561111045619 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:37.827382 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac6491c1-8aa0-41c8-8ee5-561111045619 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:37.975654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ac6491c1-8aa0-41c8-8ee5-561111045619 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:37.984270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ac6491c1-8aa0-41c8-8ee5-561111045619 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.170827 Jun 02 16:11:37.984835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 304/592] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:37 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:38.422916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:38.423526 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:38.430944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:38.431392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:38.432156 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:38.432578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:38.592060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:38.599925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:38.601429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:38.602613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-844794e4-1b93-4e02-9fa3-5e1df87ca662 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1742 microversion: 2.20 time: 0.183637 Jun 02 16:11:38.603165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 289/593] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:38 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:38.990903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-9bd3123f-859c-4bdf-bbfd-4f7371daeb1e req-98b25f64-cb26-4bd3-993c-72f8de95e82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bf99ae-5d36-4add-b49f-746e933e19cc", "name": "network-vif-plugged", "status": "completed", "tag": "95689152-b643-4d84-9f69-18b1c5d87d13"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:11:38.999807 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-9bd3123f-859c-4bdf-bbfd-4f7371daeb1e req-98b25f64-cb26-4bd3-993c-72f8de95e82d service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:39.000275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-9bd3123f-859c-4bdf-bbfd-4f7371daeb1e req-98b25f64-cb26-4bd3-993c-72f8de95e82d service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:39.002028 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-36849894-8682-44f5-8428-8263beab0c2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:39.002694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-36849894-8682-44f5-8428-8263beab0c2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:39.008981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-36849894-8682-44f5-8428-8263beab0c2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:39.009437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-36849894-8682-44f5-8428-8263beab0c2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:39.010278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-36849894-8682-44f5-8428-8263beab0c2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:39.010745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-36849894-8682-44f5-8428-8263beab0c2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:39.011420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-9bd3123f-859c-4bdf-bbfd-4f7371daeb1e req-98b25f64-cb26-4bd3-993c-72f8de95e82d service nova] Creating event network-vif-plugged:95689152-b643-4d84-9f69-18b1c5d87d13 for instance f8bf99ae-5d36-4add-b49f-746e933e19cc on hv-cinder-79760 Jun 02 16:11:39.019601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-9bd3123f-859c-4bdf-bbfd-4f7371daeb1e req-98b25f64-cb26-4bd3-993c-72f8de95e82d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032024 Jun 02 16:11:39.020483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 305/594] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:11:39.332934 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-36849894-8682-44f5-8428-8263beab0c2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:39.342786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-36849894-8682-44f5-8428-8263beab0c2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.344513 Jun 02 16:11:39.343424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 290/595] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:38 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:11:39.621355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:39.621945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:39.623911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=44 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:39.628803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:39.629247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:39.630002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:39.630456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:39.761265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:39.769266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:39.770808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:39.771988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-10a79331-7999-49ce-9e48-4c9897216ff9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1742 microversion: 2.20 time: 0.154998 Jun 02 16:11:39.772492 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 306/596] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:39 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:40.053377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:11:40.053987 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:11:40.360658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e49040f1-9cd1-4f61-bb16-13897236231b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:40.361193 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e49040f1-9cd1-4f61-bb16-13897236231b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:40.368502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e49040f1-9cd1-4f61-bb16-13897236231b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:40.369015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e49040f1-9cd1-4f61-bb16-13897236231b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:40.370425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e49040f1-9cd1-4f61-bb16-13897236231b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:40.370951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e49040f1-9cd1-4f61-bb16-13897236231b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:40.513376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e49040f1-9cd1-4f61-bb16-13897236231b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:40.521284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e49040f1-9cd1-4f61-bb16-13897236231b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.164777 Jun 02 16:11:40.521824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 291/597] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:40 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:40.790825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:40.791456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:40.798540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:40.798990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:40.799759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:40.800196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:40.929680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:40.937493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:40.939019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:40.940162 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3afc3314-9e14-41f8-a4d5-bed981b13ca4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1742 microversion: 2.20 time: 0.153220 Jun 02 16:11:40.940714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 307/598] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:40 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:41.539322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-30aeef4a-b046-484e-b4cd-d324b9968434 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:41.540109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-30aeef4a-b046-484e-b4cd-d324b9968434 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:41.549862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30aeef4a-b046-484e-b4cd-d324b9968434 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:41.550477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30aeef4a-b046-484e-b4cd-d324b9968434 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:41.551720 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30aeef4a-b046-484e-b4cd-d324b9968434 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:41.552464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30aeef4a-b046-484e-b4cd-d324b9968434 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:41.701174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-30aeef4a-b046-484e-b4cd-d324b9968434 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:41.709217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-30aeef4a-b046-484e-b4cd-d324b9968434 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.174334 Jun 02 16:11:41.709766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 292/599] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:41 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:41.957522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:41.958156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:41.964377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:41.964822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:41.965581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:41.966016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:42.094624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:42.102491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:42.114212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:42.114212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a4b99481-75ca-4675-8ef3-0e664871bb86 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1742 microversion: 2.20 time: 0.151992 Jun 02 16:11:42.114212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 308/600] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:41 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:11:42.726807 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-aaa5c930-5ee8-44df-a1fe-9f70356319c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:42.727422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-aaa5c930-5ee8-44df-a1fe-9f70356319c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:42.735081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aaa5c930-5ee8-44df-a1fe-9f70356319c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:42.735539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aaa5c930-5ee8-44df-a1fe-9f70356319c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:42.736315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aaa5c930-5ee8-44df-a1fe-9f70356319c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:42.736756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aaa5c930-5ee8-44df-a1fe-9f70356319c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:42.893996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-aaa5c930-5ee8-44df-a1fe-9f70356319c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:42.898485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-aaa5c930-5ee8-44df-a1fe-9f70356319c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.175512 Jun 02 16:11:42.899052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 293/601] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:42 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:43.124596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:43.125193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:43.131549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:43.132004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:43.132772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:43.133209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:43.277102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:43.285091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:43.287695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:43.287872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1e183ee7-d714-4945-a2b6-9ac517df1a49 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.167210 Jun 02 16:11:43.288358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 309/602] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:43 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:43.917516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-81d2d92f-61b0-475e-b754-bc6110dc9e0a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:43.918150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-81d2d92f-61b0-475e-b754-bc6110dc9e0a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:43.924686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-81d2d92f-61b0-475e-b754-bc6110dc9e0a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:43.925137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-81d2d92f-61b0-475e-b754-bc6110dc9e0a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:43.925906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-81d2d92f-61b0-475e-b754-bc6110dc9e0a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:43.926369 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-81d2d92f-61b0-475e-b754-bc6110dc9e0a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:44.075989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-81d2d92f-61b0-475e-b754-bc6110dc9e0a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:44.084287 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-81d2d92f-61b0-475e-b754-bc6110dc9e0a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.171093 Jun 02 16:11:44.084856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 294/603] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:43 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:44.306660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:44.307463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:44.313449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:44.313929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:44.314734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:44.315192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:44.464581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:44.473840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:44.475874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:44.477326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5fd8b07c-45af-447b-a554-6c317b10b4fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.174572 Jun 02 16:11:44.478150 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 310/604] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:44 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:45.102496 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d0548026-7f78-467e-8553-b7877ee6d8f8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:45.103861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d0548026-7f78-467e-8553-b7877ee6d8f8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:45.110675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d0548026-7f78-467e-8553-b7877ee6d8f8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:45.111409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d0548026-7f78-467e-8553-b7877ee6d8f8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:45.112279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d0548026-7f78-467e-8553-b7877ee6d8f8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:45.112732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d0548026-7f78-467e-8553-b7877ee6d8f8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:45.284756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d0548026-7f78-467e-8553-b7877ee6d8f8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:45.294397 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d0548026-7f78-467e-8553-b7877ee6d8f8 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.195759 Jun 02 16:11:45.295068 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 295/605] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:45 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:11:45.497717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:45.499088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:45.512114 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:45.512919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:45.513933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:45.514513 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:45.651335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:45.660549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:45.662337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:45.663571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-87550223-15ca-473f-b369-22264211b546 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.170652 Jun 02 16:11:45.664173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 311/606] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:45 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:46.312880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-83805f5a-ca70-4904-b5fe-19c9fee6bfdf tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:46.313490 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-83805f5a-ca70-4904-b5fe-19c9fee6bfdf tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:46.320309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83805f5a-ca70-4904-b5fe-19c9fee6bfdf tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:46.320761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83805f5a-ca70-4904-b5fe-19c9fee6bfdf tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:46.321523 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83805f5a-ca70-4904-b5fe-19c9fee6bfdf tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:46.321983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83805f5a-ca70-4904-b5fe-19c9fee6bfdf tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:46.497899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-83805f5a-ca70-4904-b5fe-19c9fee6bfdf tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:46.508790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-83805f5a-ca70-4904-b5fe-19c9fee6bfdf tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.199815 Jun 02 16:11:46.520732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 296/607] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:46 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:46.681321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:46.681937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:46.688136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:46.688585 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:46.689343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:46.689772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:46.839274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:46.847301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:46.852504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:46.853653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8b911e34-e89e-455c-8321-5119106f953b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.176279 Jun 02 16:11:46.854281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 312/608] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:46 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:47.527053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8389b773-76be-4810-8f36-b53f65e9a6ef tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:47.527609 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8389b773-76be-4810-8f36-b53f65e9a6ef tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:47.534067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8389b773-76be-4810-8f36-b53f65e9a6ef tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:47.534547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8389b773-76be-4810-8f36-b53f65e9a6ef tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:47.535312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8389b773-76be-4810-8f36-b53f65e9a6ef tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:47.535744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8389b773-76be-4810-8f36-b53f65e9a6ef tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:47.705524 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8389b773-76be-4810-8f36-b53f65e9a6ef tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:47.713805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8389b773-76be-4810-8f36-b53f65e9a6ef tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.190679 Jun 02 16:11:47.715194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 297/609] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:47 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:47.874306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:47.874916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:47.887724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:47.894512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:47.895349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:47.895795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:48.070120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:48.079628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:48.081448 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:48.082648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f5003f20-7e02-48a0-8447-5399e411e7f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.213105 Jun 02 16:11:48.083196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 313/610] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:47 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:48.732208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-aa1db4ee-1f83-4a44-80f8-2fa0127260c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:48.732819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-aa1db4ee-1f83-4a44-80f8-2fa0127260c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:48.739409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa1db4ee-1f83-4a44-80f8-2fa0127260c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:48.740106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa1db4ee-1f83-4a44-80f8-2fa0127260c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:48.741009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa1db4ee-1f83-4a44-80f8-2fa0127260c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:48.741467 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa1db4ee-1f83-4a44-80f8-2fa0127260c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:48.890101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-aa1db4ee-1f83-4a44-80f8-2fa0127260c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:48.898328 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-aa1db4ee-1f83-4a44-80f8-2fa0127260c9 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.170345 Jun 02 16:11:48.898896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 298/611] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:48 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:49.103127 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:49.103639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:49.110566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:49.111011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:49.111772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:49.112198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:49.257772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:49.267070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:49.268578 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:49.269766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1120ff52-1a03-41aa-868c-56348b6572dd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.170740 Jun 02 16:11:49.274383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 314/612] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:49 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:11:49.914772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9b5ef5ac-41dd-4a3a-8def-2434d3c91897 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:49.915472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9b5ef5ac-41dd-4a3a-8def-2434d3c91897 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:49.922861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b5ef5ac-41dd-4a3a-8def-2434d3c91897 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:49.923311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b5ef5ac-41dd-4a3a-8def-2434d3c91897 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:49.924085 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b5ef5ac-41dd-4a3a-8def-2434d3c91897 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:49.924519 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b5ef5ac-41dd-4a3a-8def-2434d3c91897 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:50.081468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9b5ef5ac-41dd-4a3a-8def-2434d3c91897 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:50.094643 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9b5ef5ac-41dd-4a3a-8def-2434d3c91897 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1757 microversion: 2.1 time: 0.183467 Jun 02 16:11:50.095478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 299/613] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:49 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:50.288279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:50.288888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:50.295678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:50.296128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:50.296889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:50.297323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:50.490562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:50.490562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:50.490862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:50.490862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ea80a3af-25b9-470a-ba96-96da2cc1f879 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.166797 Jun 02 16:11:50.490862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 315/614] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:50 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:51.112689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8c159b22-c447-4b9a-8725-fa5452379e85 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:51.113307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8c159b22-c447-4b9a-8725-fa5452379e85 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:51.116024 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=44 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:51.127931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c159b22-c447-4b9a-8725-fa5452379e85 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:51.128394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c159b22-c447-4b9a-8725-fa5452379e85 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:51.129183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c159b22-c447-4b9a-8725-fa5452379e85 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:51.129630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c159b22-c447-4b9a-8725-fa5452379e85 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:51.295055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8c159b22-c447-4b9a-8725-fa5452379e85 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:51.303399 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8c159b22-c447-4b9a-8725-fa5452379e85 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1760 microversion: 2.1 time: 0.194498 Jun 02 16:11:51.303968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 300/615] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:11:51 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1760 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:11:51.471184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:51.471794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:51.477972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:51.478455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:51.479875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:51.480498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:51.621838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:51.630299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:51.631978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:51.633124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-99f855e4-8e5f-4bd6-bc31-d4252cbb7042 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.166157 Jun 02 16:11:51.633675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 316/616] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:51 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:52.651683 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:52.652291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:52.659284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:52.659730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:52.660495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:52.661703 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:52.806410 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:52.815937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:52.820698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:52.820698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d653cafe-14ea-4827-b226-1ca79416f5e1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.171587 Jun 02 16:11:52.820698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 301/617] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:52 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:11:53.836985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:53.837587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:53.844733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:53.845511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:53.846550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:53.847169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:54.009229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:54.021676 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:54.024626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:54.027183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9cdded64-67cb-4b71-a378-f99c29b5c975 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.194122 Jun 02 16:11:54.028273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 317/618] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:53 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:55.046597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:55.047119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:55.053589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:55.054039 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:55.054972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:55.055250 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:55.193135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:55.202458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:55.204404 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:55.207213 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e829c87a-4a38-41ac-aaf8-197961c471ee tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.164357 Jun 02 16:11:55.208051 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 302/619] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:55 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:56.225616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:56.226265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:56.232760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:56.233213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:56.233976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:56.234467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:56.249926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:56.366778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:56.374545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:56.376032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:56.377199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3ce53910-2b15-44c9-8912-d7557233c3f1 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1737 microversion: 2.20 time: 0.155498 Jun 02 16:11:56.377747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 318/620] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:56 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:57.395830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:57.396643 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:57.403785 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:57.404237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:57.405026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:57.405472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:57.571159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:57.579334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:57.580823 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:57.581991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5931a86f-5d1d-4bec-96a5-c600ca1ec884 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1719 microversion: 2.20 time: 0.190329 Jun 02 16:11:57.582570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 303/621] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:57 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:58.601223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:58.601834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:58.608087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:58.608566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:58.609365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:58.609833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:58.742216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:58.750793 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:58.752338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:58.753488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d1d2fe06-224f-4384-ba8e-779d816e58ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1719 microversion: 2.20 time: 0.156703 Jun 02 16:11:58.754050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 319/622] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:58 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:11:59.771717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:11:59.772330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:11:59.779580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:59.780070 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:59.780834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:11:59.781271 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:11:59.911761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:59.919866 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:59.921364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:11:59.922572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-711fcc85-0735-450e-abe9-d4dc5b9364c6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1719 microversion: 2.20 time: 0.154864 Jun 02 16:11:59.923117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 304/623] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:11:59 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:00.945994 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:00.946650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:00.952774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:00.957886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:00.957886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:00.957886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:01.075948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-c66acf9e-ccd5-48fa-aa09-4a992a007ddd req-26c7caa7-d14b-443f-bddf-c742673591bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bf99ae-5d36-4add-b49f-746e933e19cc", "name": "network-vif-unplugged", "status": "completed", "tag": "95689152-b643-4d84-9f69-18b1c5d87d13"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:01.089622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-c66acf9e-ccd5-48fa-aa09-4a992a007ddd req-26c7caa7-d14b-443f-bddf-c742673591bf service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:01.089622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-c66acf9e-ccd5-48fa-aa09-4a992a007ddd req-26c7caa7-d14b-443f-bddf-c742673591bf service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:01.089825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:01.090543 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:01.096869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:01.098467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:01.099626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-df2cbc09-0865-4160-a5c4-c5bd277f5426 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1722 microversion: 2.20 time: 0.157606 Jun 02 16:12:01.100084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-c66acf9e-ccd5-48fa-aa09-4a992a007ddd req-26c7caa7-d14b-443f-bddf-c742673591bf service nova] Creating event network-vif-unplugged:95689152-b643-4d84-9f69-18b1c5d87d13 for instance f8bf99ae-5d36-4add-b49f-746e933e19cc on hv-cinder-79760 Jun 02 16:12:01.103015 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 320/624] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:00 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:01.106210 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-c66acf9e-ccd5-48fa-aa09-4a992a007ddd req-26c7caa7-d14b-443f-bddf-c742673591bf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034838 Jun 02 16:12:01.107129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 305/625] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:12:01.117393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a4102e1c-5070-4eec-9d00-bcabc215c383 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87a67192-8bf8-4cb6-a8ab-9b51fa9b26a5"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:01.118467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a4102e1c-5070-4eec-9d00-bcabc215c383 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:01.125153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4102e1c-5070-4eec-9d00-bcabc215c383 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:01.125601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4102e1c-5070-4eec-9d00-bcabc215c383 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:01.126409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4102e1c-5070-4eec-9d00-bcabc215c383 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:01.126851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4102e1c-5070-4eec-9d00-bcabc215c383 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:02.396320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a4102e1c-5070-4eec-9d00-bcabc215c383 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.282608 Jun 02 16:12:02.396951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 321/626] 10.222.0.59 () {62 vars in 1363 bytes} [Thu Jun 2 16:12:01 2022] POST /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments => generated 188 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:12:02.511093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-21946ebc-fd94-4686-a4c7-717037a940db tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:02.511744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-21946ebc-fd94-4686-a4c7-717037a940db tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:02.520668 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21946ebc-fd94-4686-a4c7-717037a940db tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:02.521113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21946ebc-fd94-4686-a4c7-717037a940db tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:02.521985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21946ebc-fd94-4686-a4c7-717037a940db tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:02.522453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21946ebc-fd94-4686-a4c7-717037a940db tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:02.782655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-21946ebc-fd94-4686-a4c7-717037a940db tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/action" status: 202 len: 0 microversion: 2.20 time: 0.275560 Jun 02 16:12:02.783308 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 306/627] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jun 2 16:12:02 2022] POST /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:12:02.791220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:02.791821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:02.797760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:02.798249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:02.798990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:02.799422 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:02.931679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:02.941279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:02.942811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:02.943965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b30e18fb-40a3-4e01-8a72-ee01a405cdc2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1748 microversion: 2.20 time: 0.156545 Jun 02 16:12:02.944526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 322/628] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:02 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:03.963236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:03.963840 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:03.971258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:03.971705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:03.972461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:03.972893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:04.103894 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:04.112825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:04.114362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:04.115527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-76d41207-7298-46d1-a0a2-14b418a2b9a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1748 microversion: 2.20 time: 0.156215 Jun 02 16:12:04.116145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 307/629] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:03 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:05.138956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:05.139492 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:05.145440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:05.145892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:05.146682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:05.147120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:05.275180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:05.284331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:05.285811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:05.287013 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-083d8e06-afc8-47bb-984f-d42303fbfd39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1750 microversion: 2.20 time: 0.152652 Jun 02 16:12:05.287562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 323/630] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:05 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:06.306337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:06.306985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:06.314174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:06.315250 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:06.315383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:06.315824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:06.448364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:06.457066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:06.459112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:06.459989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b6a61756-df1c-407f-afdc-a4d1b8f5a116 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1750 microversion: 2.20 time: 0.157660 Jun 02 16:12:06.460548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 308/631] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:06 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:07.479025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:07.480304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:07.486290 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:07.486738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:07.487496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:07.487932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:07.615117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:07.623806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:07.625235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:07.626471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-041ac7ab-8e94-4a9d-b5fe-50cea6dd2762 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.151373 Jun 02 16:12:07.633053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 324/632] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:07 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:08.645856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:08.646480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:08.653848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:08.655617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:08.656423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:08.656863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:08.795015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:08.803892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:08.805488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:08.806802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-87869233-b02a-4409-93ba-27027d00d5c5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.164858 Jun 02 16:12:08.807432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 309/633] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:08 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:09.583391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a4a828e4-f8b5-4c98-881a-cdd304cadaf8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f6280a1-4a3d-4aa7-837b-65498e77807e"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:09.584495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a4a828e4-f8b5-4c98-881a-cdd304cadaf8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:09.592262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4a828e4-f8b5-4c98-881a-cdd304cadaf8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:09.593097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4a828e4-f8b5-4c98-881a-cdd304cadaf8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:09.593906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4a828e4-f8b5-4c98-881a-cdd304cadaf8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:09.594372 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a4a828e4-f8b5-4c98-881a-cdd304cadaf8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:09.825413 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:09.825979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:09.832566 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:09.833069 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:09.833910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:09.834452 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:09.985948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:09.994636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:09.996835 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:09.998010 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b2eb8b6f-a7e1-4eae-a613-e5955b933b5e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.177103 Jun 02 16:12:09.998597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 310/634] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:09 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:11.017155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:11.017838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:11.024790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:11.025239 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:11.026355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:11.027357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:11.164484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:11.173378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:11.175120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:11.176507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6258ef19-bc2e-4922-8389-c11b1237a37a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.163453 Jun 02 16:12:11.177185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 311/635] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:11 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:12.194675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:12.195379 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:12.201942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:12.202424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:12.203282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:12.203711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:12.341738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:12.351427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:12.352960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:12.354152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ff293dff-900c-4c60-b893-c18c9645c1f5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.163331 Jun 02 16:12:12.354747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 312/636] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:12 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:13.373110 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:13.373866 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:13.380461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:13.380911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:13.381685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:13.384513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:13.522839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:13.533165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:13.534732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:13.535907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-743a6521-0430-41ee-8f72-b10202acad50 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.167026 Jun 02 16:12:13.536464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 313/637] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:13 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:14.554376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:14.555294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:14.562578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:14.563033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:14.563803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:14.564232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:14.713541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:14.722777 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:14.724527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:14.725432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fd7fbecb-fd13-4112-b190-9989098a286b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.175122 Jun 02 16:12:14.725985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 314/638] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:14 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:15.753534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:15.754276 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:15.760762 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:15.761325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:15.762453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:15.762908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:15.899686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:15.908577 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:15.916368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:15.918498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b1bc0193-7924-4e71-87e3-e2bde5e22569 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.168620 Jun 02 16:12:15.919615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 315/639] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:15 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:16.937169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:16.938691 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:16.945454 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:16.945907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:16.946821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:16.947308 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:17.083702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:17.093009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:17.094550 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:17.095706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a2fd181d-952e-4049-890a-07c87ac70d11 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.162858 Jun 02 16:12:17.096257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 316/640] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:16 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:18.114404 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:18.115801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:18.124366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:18.124366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:18.124909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:18.125575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:18.273510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:18.282313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:18.283826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:18.284996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7f3b739f-3bb0-4318-a3bf-c125251efde3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.174724 Jun 02 16:12:18.285754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 317/641] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:18 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:19.304285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:19.305064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:19.312411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:19.312869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:19.313870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:19.314294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:19.449025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:19.457857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:19.459471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:19.460707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-64fd5ed3-ea6f-4e4a-bb6f-f09670039d95 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.160706 Jun 02 16:12:19.461337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 318/642] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:19 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:19.588404 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=39 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:19.669211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:20.481294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:20.481926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:20.488382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:20.488828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:20.489616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:20.490045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:20.621536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:20.629960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:20.631503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:20.632672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3e1d3949-cf08-4bc5-80f4-42bc1d60f3da tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.155891 Jun 02 16:12:20.633228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 319/643] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:20 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:21.652000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:21.652639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:21.655092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=42 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:21.659831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:21.660286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:21.661060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:21.661521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:21.794165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:21.803007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:21.804615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:21.805805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-60759756-1cfa-449b-8ad8-9085a7fecfc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.158244 Jun 02 16:12:21.806400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 320/644] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:21 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:22.824777 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:22.825383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:22.831779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:22.832232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:22.833007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:22.833481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:22.849277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:22.963341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:22.972095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:22.973739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:22.974936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-69761738-a681-464c-8d8c-210e9b99e798 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.154955 Jun 02 16:12:22.975510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 321/645] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:22 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:23.993959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:23.994697 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:24.001226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:24.001682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:24.002482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:24.002922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:24.137693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:24.146142 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:24.147669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:24.148833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7609791b-f097-4c34-ad00-dbf2875ccd1a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.158916 Jun 02 16:12:24.149422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 322/646] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:23 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:25.091175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a4a828e4-f8b5-4c98-881a-cdd304cadaf8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.618594 Jun 02 16:12:25.092098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 325/647] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:12:09 2022] POST /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments => generated 194 bytes in 15620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:12:25.168357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:25.168966 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:25.175627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:25.176084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:25.176863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:25.177301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:25.348678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:25.357045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:25.358608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:25.359776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bf9a32d7-b986-4c1b-a25e-3f23ea9db4c8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.195999 Jun 02 16:12:25.360338 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 323/648] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:25 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:26.379234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:26.379836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:26.387836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:26.388365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:26.389200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:26.389631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:26.518453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:26.527467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:26.528952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:26.530115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-85277b67-2eae-442e-89a5-9bb0327b51dc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.155356 Jun 02 16:12:26.530660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 326/649] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:26 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:27.547623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:27.548170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:27.554773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:27.555228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:27.555997 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:27.556438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:27.689795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:27.698769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:27.700355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:27.701517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a606efdd-5662-4354-ab9d-af949b624acc tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.157909 Jun 02 16:12:27.702119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 324/650] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:27 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:28.720124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:28.720726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:28.727832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:28.732286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:28.732286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:28.732286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:28.859104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:28.867494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:28.868984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:28.870682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-12203e7c-72b5-40c4-80d8-8f9f21216760 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.154161 Jun 02 16:12:28.871226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 327/651] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:28 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:29.888129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:29.888733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:29.896394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:29.896848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:29.897622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:29.898063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:30.027513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:30.035994 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:30.037559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:30.038766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-da9b0643-bc8d-44af-8538-87ba3fcc9513 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.154526 Jun 02 16:12:30.039323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 325/652] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:29 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:31.057291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:31.057964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:31.064981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:31.065453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:31.066251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:31.066684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:31.199176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:31.207594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:31.209155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:31.210332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8e80ccd8-712f-4fed-99cb-6c37dca44665 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.156882 Jun 02 16:12:31.210879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 328/653] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:31 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:31.999164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5049ed7d-7d3a-48e4-8dba-d0e116d49c58 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:31.999700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5049ed7d-7d3a-48e4-8dba-d0e116d49c58 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:32.005747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5049ed7d-7d3a-48e4-8dba-d0e116d49c58 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:32.006243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5049ed7d-7d3a-48e4-8dba-d0e116d49c58 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:32.007017 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5049ed7d-7d3a-48e4-8dba-d0e116d49c58 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:32.007458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5049ed7d-7d3a-48e4-8dba-d0e116d49c58 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:32.134596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-5049ed7d-7d3a-48e4-8dba-d0e116d49c58 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lazy-loading 'services' on Instance uuid 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:12:32.228762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:32.229373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:32.235926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:32.236383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:32.237171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:32.237630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:32.370875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:32.379461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:32.381010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:32.382189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b20e3f86-517f-4428-9836-4e685a5cc913 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.157213 Jun 02 16:12:32.382753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 329/654] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:32 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:32.419990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5049ed7d-7d3a-48e4-8dba-d0e116d49c58 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "DELETE /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/os-volume_attachments/2f4a0cd7-ce8a-407c-ba46-96dbf8083890" status: 202 len: 0 microversion: 2.1 time: 0.526912 Jun 02 16:12:32.420599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 326/655] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:12:31 2022] DELETE /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/os-volume_attachments/2f4a0cd7-ce8a-407c-ba46-96dbf8083890 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:12:33.400763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:33.402875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:33.413710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:33.413710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:33.414454 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:33.414700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:33.561097 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-a9b00ade-9e3d-4fbc-afd6-f24768f56b82 req-900dbf18-d941-4449-bd01-9c8a865badb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bf99ae-5d36-4add-b49f-746e933e19cc", "name": "network-vif-plugged", "status": "completed", "tag": "95689152-b643-4d84-9f69-18b1c5d87d13"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:33.570614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:33.570831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-a9b00ade-9e3d-4fbc-afd6-f24768f56b82 req-900dbf18-d941-4449-bd01-9c8a865badb5 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:33.571448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-a9b00ade-9e3d-4fbc-afd6-f24768f56b82 req-900dbf18-d941-4449-bd01-9c8a865badb5 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:33.584051 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-a9b00ade-9e3d-4fbc-afd6-f24768f56b82 req-900dbf18-d941-4449-bd01-9c8a865badb5 service nova] Creating event network-vif-plugged:95689152-b643-4d84-9f69-18b1c5d87d13 for instance f8bf99ae-5d36-4add-b49f-746e933e19cc on hv-cinder-79760 Jun 02 16:12:33.596480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:33.596480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:33.596480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6f988774-2e2d-4e33-8573-e5d56ecf1264 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.194596 Jun 02 16:12:33.596999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 330/656] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:33 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:33.604888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-a9b00ade-9e3d-4fbc-afd6-f24768f56b82 req-900dbf18-d941-4449-bd01-9c8a865badb5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129167 Jun 02 16:12:33.606718 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 327/657] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:12:34.610234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:34.610864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:34.617196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:34.617641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:34.618420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:34.618852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:34.712194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-504d1788-6cc1-4b25-ab10-29a197b4bb7c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:34.713226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-504d1788-6cc1-4b25-ab10-29a197b4bb7c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:34.720622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-504d1788-6cc1-4b25-ab10-29a197b4bb7c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:34.721075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-504d1788-6cc1-4b25-ab10-29a197b4bb7c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:34.721847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-504d1788-6cc1-4b25-ab10-29a197b4bb7c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:34.722325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-504d1788-6cc1-4b25-ab10-29a197b4bb7c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:34.745439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-504d1788-6cc1-4b25-ab10-29a197b4bb7c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lazy-loading 'flavor' on Instance uuid 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:12:34.751599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:34.763286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:34.765317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:34.766628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9a5a4888-8971-4c70-ab79-8379cc5f281b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.160846 Jun 02 16:12:34.767663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 331/658] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:34 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:35.269900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-504d1788-6cc1-4b25-ab10-29a197b4bb7c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/action" status: 200 len: 32 microversion: 2.1 time: 0.562443 Jun 02 16:12:35.270587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 328/659] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:12:34 2022] POST /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/action => generated 32 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 16:12:35.280493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-83681c9f-d596-4d5f-a0e8-73e2e8a5dd6c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:35.281096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-83681c9f-d596-4d5f-a0e8-73e2e8a5dd6c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:35.287111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83681c9f-d596-4d5f-a0e8-73e2e8a5dd6c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:35.287555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83681c9f-d596-4d5f-a0e8-73e2e8a5dd6c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:35.288333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83681c9f-d596-4d5f-a0e8-73e2e8a5dd6c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:35.288760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83681c9f-d596-4d5f-a0e8-73e2e8a5dd6c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:35.417095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-83681c9f-d596-4d5f-a0e8-73e2e8a5dd6c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:35.425074 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-83681c9f-d596-4d5f-a0e8-73e2e8a5dd6c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.149219 Jun 02 16:12:35.425633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 332/660] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:35 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:35.648828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a9a20f39-ac5d-46ba-b45d-28896e259181 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:35.655444 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9a20f39-ac5d-46ba-b45d-28896e259181 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:35.655901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9a20f39-ac5d-46ba-b45d-28896e259181 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:35.678757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a9a20f39-ac5d-46ba-b45d-28896e259181 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Going to try to stop instance {{(pid=118257) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 16:12:35.785081 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:35.785865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:35.792407 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:35.792856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:35.794332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:35.794783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:35.897446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a9a20f39-ac5d-46ba-b45d-28896e259181 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/action" status: 202 len: 0 microversion: 2.1 time: 0.252804 Jun 02 16:12:35.898158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 329/661] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:12:35 2022] POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:12:35.906928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fc43435a-0a96-45c8-b32a-9848447e842f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:35.907633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fc43435a-0a96-45c8-b32a-9848447e842f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:35.913712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc43435a-0a96-45c8-b32a-9848447e842f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:35.914196 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc43435a-0a96-45c8-b32a-9848447e842f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:35.914963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc43435a-0a96-45c8-b32a-9848447e842f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:35.915402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc43435a-0a96-45c8-b32a-9848447e842f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:35.929156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:35.937646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:35.939180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:35.940344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-46a4dc58-66c0-48fd-bd3b-7b4c13d67ad3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.159295 Jun 02 16:12:35.940936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 333/662] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:35 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:12:36.044480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fc43435a-0a96-45c8-b32a-9848447e842f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:36.052139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fc43435a-0a96-45c8-b32a-9848447e842f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.149872 Jun 02 16:12:36.052709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 330/663] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:35 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:36.443577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-86bd68b5-6f12-49d7-9835-0bb0ccf6a536 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:36.444446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-86bd68b5-6f12-49d7-9835-0bb0ccf6a536 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:36.451771 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86bd68b5-6f12-49d7-9835-0bb0ccf6a536 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:36.452066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86bd68b5-6f12-49d7-9835-0bb0ccf6a536 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:36.453278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86bd68b5-6f12-49d7-9835-0bb0ccf6a536 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:36.453278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86bd68b5-6f12-49d7-9835-0bb0ccf6a536 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:36.587015 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-86bd68b5-6f12-49d7-9835-0bb0ccf6a536 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:36.596866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-86bd68b5-6f12-49d7-9835-0bb0ccf6a536 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.157034 Jun 02 16:12:36.597445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 334/664] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:36 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:36.959924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:36.960570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:36.968305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:36.968759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:36.969551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:36.969990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:37.070124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c1f4a1d2-a4bd-4545-9158-1ddb56b8315e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:37.070738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c1f4a1d2-a4bd-4545-9158-1ddb56b8315e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:37.078240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1f4a1d2-a4bd-4545-9158-1ddb56b8315e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:37.078694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1f4a1d2-a4bd-4545-9158-1ddb56b8315e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:37.079468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1f4a1d2-a4bd-4545-9158-1ddb56b8315e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:37.079961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1f4a1d2-a4bd-4545-9158-1ddb56b8315e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:37.130390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:37.139405 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:37.140909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:37.142104 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6bed4caf-d770-4c51-8437-3722ecbcfa8b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.186110 Jun 02 16:12:37.142661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 331/665] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:36 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:37.223682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c1f4a1d2-a4bd-4545-9158-1ddb56b8315e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:37.231580 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c1f4a1d2-a4bd-4545-9158-1ddb56b8315e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.165240 Jun 02 16:12:37.232678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 335/666] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:37 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:37.614815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-63ae4026-cd99-4698-80ed-df060260d299 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:37.615431 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-63ae4026-cd99-4698-80ed-df060260d299 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:37.621759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63ae4026-cd99-4698-80ed-df060260d299 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:37.622268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63ae4026-cd99-4698-80ed-df060260d299 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:37.626221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63ae4026-cd99-4698-80ed-df060260d299 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:37.626221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63ae4026-cd99-4698-80ed-df060260d299 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:37.840299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-63ae4026-cd99-4698-80ed-df060260d299 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:37.848589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-63ae4026-cd99-4698-80ed-df060260d299 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.237555 Jun 02 16:12:37.849150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 332/667] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:37 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:38.160677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:38.161422 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:38.168588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:38.169043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:38.169806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:38.170268 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:38.249664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-918cca19-3ae7-463d-9bea-257687e7eb49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:38.250055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-918cca19-3ae7-463d-9bea-257687e7eb49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:38.257047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-918cca19-3ae7-463d-9bea-257687e7eb49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:38.257508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-918cca19-3ae7-463d-9bea-257687e7eb49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:38.258330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-918cca19-3ae7-463d-9bea-257687e7eb49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:38.258758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-918cca19-3ae7-463d-9bea-257687e7eb49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:38.303100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:38.312247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:38.314250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:38.315578 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e63f6ffb-8059-4a69-895a-927efee66c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1806 microversion: 2.20 time: 0.158745 Jun 02 16:12:38.316620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 336/668] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:38 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:38.394737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-918cca19-3ae7-463d-9bea-257687e7eb49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:38.404058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-918cca19-3ae7-463d-9bea-257687e7eb49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.159224 Jun 02 16:12:38.404692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 333/669] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:38 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:38.866643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-510d28e1-35de-44be-9ac3-0a7c1367af29 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:38.867256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-510d28e1-35de-44be-9ac3-0a7c1367af29 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:38.873935 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-510d28e1-35de-44be-9ac3-0a7c1367af29 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:38.874418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-510d28e1-35de-44be-9ac3-0a7c1367af29 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:38.875191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-510d28e1-35de-44be-9ac3-0a7c1367af29 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:38.875631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-510d28e1-35de-44be-9ac3-0a7c1367af29 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:39.006801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-510d28e1-35de-44be-9ac3-0a7c1367af29 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:39.015150 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-510d28e1-35de-44be-9ac3-0a7c1367af29 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.152401 Jun 02 16:12:39.015720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 337/670] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:38 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:39.335285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:39.335895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:39.343686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:39.344141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:39.344902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:39.345510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:39.421964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-62e6def5-5217-4f22-a422-77e22960fdfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:39.422606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-62e6def5-5217-4f22-a422-77e22960fdfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:39.428879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62e6def5-5217-4f22-a422-77e22960fdfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:39.429533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62e6def5-5217-4f22-a422-77e22960fdfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:39.430329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62e6def5-5217-4f22-a422-77e22960fdfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:39.430768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62e6def5-5217-4f22-a422-77e22960fdfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:39.478081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:39.487549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:39.489127 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:39.490607 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-415dd595-3b37-433f-8bd6-4c6c90c016ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1793 microversion: 2.20 time: 0.159227 Jun 02 16:12:39.491183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 334/671] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:12:39 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1793 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:12:39.558112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-62e6def5-5217-4f22-a422-77e22960fdfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:39.565533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-62e6def5-5217-4f22-a422-77e22960fdfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.148267 Jun 02 16:12:39.566118 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 338/672] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:39 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:40.032375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-19b7c6ac-8ad9-4a4e-9a78-08386891f9ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:40.032986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-19b7c6ac-8ad9-4a4e-9a78-08386891f9ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:40.039049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-19b7c6ac-8ad9-4a4e-9a78-08386891f9ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:40.039498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-19b7c6ac-8ad9-4a4e-9a78-08386891f9ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:40.040258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-19b7c6ac-8ad9-4a4e-9a78-08386891f9ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:40.040698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-19b7c6ac-8ad9-4a4e-9a78-08386891f9ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:40.045170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:40.171345 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-19b7c6ac-8ad9-4a4e-9a78-08386891f9ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:40.179538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-19b7c6ac-8ad9-4a4e-9a78-08386891f9ba tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.150983 Jun 02 16:12:40.187364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 335/673] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:40 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:40.581844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f9e84c48-2e1e-48f1-8c25-f33346891e54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:40.582452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f9e84c48-2e1e-48f1-8c25-f33346891e54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:40.588399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9e84c48-2e1e-48f1-8c25-f33346891e54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:40.588839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9e84c48-2e1e-48f1-8c25-f33346891e54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:40.589752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9e84c48-2e1e-48f1-8c25-f33346891e54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:40.590831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9e84c48-2e1e-48f1-8c25-f33346891e54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:40.718315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f9e84c48-2e1e-48f1-8c25-f33346891e54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:40.725614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f9e84c48-2e1e-48f1-8c25-f33346891e54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.147710 Jun 02 16:12:40.726186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 339/674] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:40 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:41.196766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bfa69f10-c0d0-4bc5-92d6-da136cdf8ddb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:41.197419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bfa69f10-c0d0-4bc5-92d6-da136cdf8ddb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:41.204535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bfa69f10-c0d0-4bc5-92d6-da136cdf8ddb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:41.204985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bfa69f10-c0d0-4bc5-92d6-da136cdf8ddb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:41.205784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bfa69f10-c0d0-4bc5-92d6-da136cdf8ddb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:41.206260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bfa69f10-c0d0-4bc5-92d6-da136cdf8ddb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:41.338386 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bfa69f10-c0d0-4bc5-92d6-da136cdf8ddb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:41.346897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bfa69f10-c0d0-4bc5-92d6-da136cdf8ddb tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.154041 Jun 02 16:12:41.347474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 336/675] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:41 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:41.742876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6d575704-4ace-4d1a-a44f-d693a810e150 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:41.743488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6d575704-4ace-4d1a-a44f-d693a810e150 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:41.750294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d575704-4ace-4d1a-a44f-d693a810e150 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:41.750745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d575704-4ace-4d1a-a44f-d693a810e150 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:41.751511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d575704-4ace-4d1a-a44f-d693a810e150 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:41.751940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d575704-4ace-4d1a-a44f-d693a810e150 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:41.880881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6d575704-4ace-4d1a-a44f-d693a810e150 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:41.888286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6d575704-4ace-4d1a-a44f-d693a810e150 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.149273 Jun 02 16:12:41.888848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 340/676] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:41 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:42.365349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c43d8af2-d036-4530-8b7d-1cd1b49eb9e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:42.365863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c43d8af2-d036-4530-8b7d-1cd1b49eb9e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:42.373388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c43d8af2-d036-4530-8b7d-1cd1b49eb9e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:42.373842 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c43d8af2-d036-4530-8b7d-1cd1b49eb9e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:42.374643 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c43d8af2-d036-4530-8b7d-1cd1b49eb9e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:42.375081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c43d8af2-d036-4530-8b7d-1cd1b49eb9e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:42.503363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c43d8af2-d036-4530-8b7d-1cd1b49eb9e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:42.511242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c43d8af2-d036-4530-8b7d-1cd1b49eb9e3 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.150286 Jun 02 16:12:42.511849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 337/677] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:42 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:42.906405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-90274e12-2686-4613-8e63-3175176d62f3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:42.906977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-90274e12-2686-4613-8e63-3175176d62f3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:42.913343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-90274e12-2686-4613-8e63-3175176d62f3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:42.913791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-90274e12-2686-4613-8e63-3175176d62f3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:42.914595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-90274e12-2686-4613-8e63-3175176d62f3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:42.915033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-90274e12-2686-4613-8e63-3175176d62f3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:42.919397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:43.044185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-90274e12-2686-4613-8e63-3175176d62f3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:43.051488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-90274e12-2686-4613-8e63-3175176d62f3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.149815 Jun 02 16:12:43.052082 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 341/678] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:42 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:43.528575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5b2842da-c346-4dba-9e2f-fa286c9951e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:43.529093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5b2842da-c346-4dba-9e2f-fa286c9951e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:43.535633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b2842da-c346-4dba-9e2f-fa286c9951e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:43.536090 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b2842da-c346-4dba-9e2f-fa286c9951e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:43.536875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b2842da-c346-4dba-9e2f-fa286c9951e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:43.537358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b2842da-c346-4dba-9e2f-fa286c9951e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:43.667044 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5b2842da-c346-4dba-9e2f-fa286c9951e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:43.675600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5b2842da-c346-4dba-9e2f-fa286c9951e1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.151100 Jun 02 16:12:43.676167 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 338/679] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:43 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:44.069881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1fee6497-e061-41eb-9690-d42528384fc4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:44.070524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1fee6497-e061-41eb-9690-d42528384fc4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:44.077552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fee6497-e061-41eb-9690-d42528384fc4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:44.092069 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fee6497-e061-41eb-9690-d42528384fc4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:44.092069 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fee6497-e061-41eb-9690-d42528384fc4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:44.092069 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fee6497-e061-41eb-9690-d42528384fc4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:44.435712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1fee6497-e061-41eb-9690-d42528384fc4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:44.443193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1fee6497-e061-41eb-9690-d42528384fc4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.377680 Jun 02 16:12:44.443788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 342/680] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:44 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:44.693191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-686f5557-831a-4509-b446-ca9cc805b10a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:44.693760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-686f5557-831a-4509-b446-ca9cc805b10a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:44.700982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-686f5557-831a-4509-b446-ca9cc805b10a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:44.701428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-686f5557-831a-4509-b446-ca9cc805b10a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:44.702217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-686f5557-831a-4509-b446-ca9cc805b10a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:44.702650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-686f5557-831a-4509-b446-ca9cc805b10a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:44.834585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-686f5557-831a-4509-b446-ca9cc805b10a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:44.842507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-686f5557-831a-4509-b446-ca9cc805b10a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.153272 Jun 02 16:12:44.843330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 339/681] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:44 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:45.460854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8aa1b125-de86-4d56-9f17-9ed36adef8b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:45.461411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8aa1b125-de86-4d56-9f17-9ed36adef8b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:45.469110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8aa1b125-de86-4d56-9f17-9ed36adef8b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:45.469564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8aa1b125-de86-4d56-9f17-9ed36adef8b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:45.470359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8aa1b125-de86-4d56-9f17-9ed36adef8b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:45.470802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8aa1b125-de86-4d56-9f17-9ed36adef8b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:45.598219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8aa1b125-de86-4d56-9f17-9ed36adef8b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:45.606185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8aa1b125-de86-4d56-9f17-9ed36adef8b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.148627 Jun 02 16:12:45.606751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 343/682] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:45 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:45.863651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-67671b84-3a5b-426e-bf6b-b597d306253c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:45.864175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-67671b84-3a5b-426e-bf6b-b597d306253c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:45.870984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67671b84-3a5b-426e-bf6b-b597d306253c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:45.871529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67671b84-3a5b-426e-bf6b-b597d306253c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:45.872315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67671b84-3a5b-426e-bf6b-b597d306253c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:45.872755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67671b84-3a5b-426e-bf6b-b597d306253c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:46.001016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-67671b84-3a5b-426e-bf6b-b597d306253c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:46.008830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-67671b84-3a5b-426e-bf6b-b597d306253c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.149151 Jun 02 16:12:46.009392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 340/683] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:45 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:46.623530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c1d52953-f617-4bf5-aea2-7e51e7b5dc5f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:46.624150 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c1d52953-f617-4bf5-aea2-7e51e7b5dc5f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:46.630591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1d52953-f617-4bf5-aea2-7e51e7b5dc5f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:46.631031 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1d52953-f617-4bf5-aea2-7e51e7b5dc5f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:46.631783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1d52953-f617-4bf5-aea2-7e51e7b5dc5f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:46.632213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1d52953-f617-4bf5-aea2-7e51e7b5dc5f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:46.761062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c1d52953-f617-4bf5-aea2-7e51e7b5dc5f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:46.768493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c1d52953-f617-4bf5-aea2-7e51e7b5dc5f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1676 microversion: 2.1 time: 0.149440 Jun 02 16:12:46.769054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 344/684] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:46 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:47.026697 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-55dac297-64c5-489c-b5a5-6c833e8ebc6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:47.027848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-55dac297-64c5-489c-b5a5-6c833e8ebc6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:47.033898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55dac297-64c5-489c-b5a5-6c833e8ebc6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:47.034382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55dac297-64c5-489c-b5a5-6c833e8ebc6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:47.035148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55dac297-64c5-489c-b5a5-6c833e8ebc6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:47.035588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55dac297-64c5-489c-b5a5-6c833e8ebc6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:47.169168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-55dac297-64c5-489c-b5a5-6c833e8ebc6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:47.177380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-55dac297-64c5-489c-b5a5-6c833e8ebc6a tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.154616 Jun 02 16:12:47.177961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 341/685] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:47 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:47.786351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b16384ef-e814-4366-8114-9996602a4c13 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:47.786970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b16384ef-e814-4366-8114-9996602a4c13 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:47.794259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b16384ef-e814-4366-8114-9996602a4c13 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:47.794715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b16384ef-e814-4366-8114-9996602a4c13 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:47.795477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b16384ef-e814-4366-8114-9996602a4c13 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:47.795917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b16384ef-e814-4366-8114-9996602a4c13 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:47.928753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b16384ef-e814-4366-8114-9996602a4c13 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:47.936250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b16384ef-e814-4366-8114-9996602a4c13 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1653 microversion: 2.1 time: 0.154185 Jun 02 16:12:47.936809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 345/686] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:47 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1653 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:47.953571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6f705539-0732-49c4-b111-7c316e964c19 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:47.959971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6f705539-0732-49c4-b111-7c316e964c19 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:47.960443 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6f705539-0732-49c4-b111-7c316e964c19 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:47.983728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6f705539-0732-49c4-b111-7c316e964c19 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Going to try to start instance {{(pid=118257) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 16:12:48.194033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bcbe0be2-d868-49c0-b5f3-4128d31373a6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:48.194686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bcbe0be2-d868-49c0-b5f3-4128d31373a6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:48.201885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcbe0be2-d868-49c0-b5f3-4128d31373a6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:48.202428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcbe0be2-d868-49c0-b5f3-4128d31373a6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:48.203231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcbe0be2-d868-49c0-b5f3-4128d31373a6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:48.203672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bcbe0be2-d868-49c0-b5f3-4128d31373a6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:48.218267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6f705539-0732-49c4-b111-7c316e964c19 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/action" status: 202 len: 0 microversion: 2.1 time: 0.268963 Jun 02 16:12:48.219165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 342/687] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:12:47 2022] POST /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:12:48.227822 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2ea7b3ef-fdfd-4886-9c70-219bdb665123 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:48.228557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2ea7b3ef-fdfd-4886-9c70-219bdb665123 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:48.235541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ea7b3ef-fdfd-4886-9c70-219bdb665123 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:48.235982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ea7b3ef-fdfd-4886-9c70-219bdb665123 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:48.236771 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ea7b3ef-fdfd-4886-9c70-219bdb665123 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:48.237209 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ea7b3ef-fdfd-4886-9c70-219bdb665123 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:48.349429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bcbe0be2-d868-49c0-b5f3-4128d31373a6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:48.359501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bcbe0be2-d868-49c0-b5f3-4128d31373a6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.169412 Jun 02 16:12:48.360208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 346/688] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:48 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:48.372453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2ea7b3ef-fdfd-4886-9c70-219bdb665123 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:48.381879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2ea7b3ef-fdfd-4886-9c70-219bdb665123 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1662 microversion: 2.1 time: 0.156812 Jun 02 16:12:48.381879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 343/689] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:48 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:49.377293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-257f7ec7-0c0c-4e07-8ae7-59b3d00cd219 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:49.378008 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-257f7ec7-0c0c-4e07-8ae7-59b3d00cd219 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:49.384386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257f7ec7-0c0c-4e07-8ae7-59b3d00cd219 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:49.384826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257f7ec7-0c0c-4e07-8ae7-59b3d00cd219 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:49.385572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257f7ec7-0c0c-4e07-8ae7-59b3d00cd219 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:49.386000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257f7ec7-0c0c-4e07-8ae7-59b3d00cd219 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:49.397789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0926a230-8314-4546-af74-e7253f8153af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:49.398431 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0926a230-8314-4546-af74-e7253f8153af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:49.406345 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0926a230-8314-4546-af74-e7253f8153af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:49.406802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0926a230-8314-4546-af74-e7253f8153af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:49.407580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0926a230-8314-4546-af74-e7253f8153af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:49.408021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0926a230-8314-4546-af74-e7253f8153af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:49.520581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-257f7ec7-0c0c-4e07-8ae7-59b3d00cd219 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:49.529475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-257f7ec7-0c0c-4e07-8ae7-59b3d00cd219 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.155884 Jun 02 16:12:49.530048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 347/690] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:49 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:49.548387 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0926a230-8314-4546-af74-e7253f8153af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:49.551630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0926a230-8314-4546-af74-e7253f8153af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1662 microversion: 2.1 time: 0.157766 Jun 02 16:12:49.552193 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 344/691] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:49 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:50.546912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2ac6d304-a681-41e0-ac38-5cb212867e85 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:50.547512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2ac6d304-a681-41e0-ac38-5cb212867e85 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:50.549764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=45 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:50.554435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ac6d304-a681-41e0-ac38-5cb212867e85 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:50.554877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ac6d304-a681-41e0-ac38-5cb212867e85 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:50.555657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ac6d304-a681-41e0-ac38-5cb212867e85 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:50.556087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ac6d304-a681-41e0-ac38-5cb212867e85 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:50.568664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2238d7a2-3064-435e-92b1-0f55fe2cf66c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:50.569310 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2238d7a2-3064-435e-92b1-0f55fe2cf66c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:50.576006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2238d7a2-3064-435e-92b1-0f55fe2cf66c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:50.576463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2238d7a2-3064-435e-92b1-0f55fe2cf66c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:50.577234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2238d7a2-3064-435e-92b1-0f55fe2cf66c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:50.577672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2238d7a2-3064-435e-92b1-0f55fe2cf66c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:50.688799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2ac6d304-a681-41e0-ac38-5cb212867e85 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:50.696772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2ac6d304-a681-41e0-ac38-5cb212867e85 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.154373 Jun 02 16:12:50.697339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 348/692] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:50 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:50.712549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2238d7a2-3064-435e-92b1-0f55fe2cf66c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:50.721153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2238d7a2-3064-435e-92b1-0f55fe2cf66c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1666 microversion: 2.1 time: 0.156312 Jun 02 16:12:50.726675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 345/693] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:50 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:51.714043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e9cd2a83-8104-4f28-8c27-a6a43029f050 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:51.714748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e9cd2a83-8104-4f28-8c27-a6a43029f050 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:51.721389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9cd2a83-8104-4f28-8c27-a6a43029f050 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:51.721832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9cd2a83-8104-4f28-8c27-a6a43029f050 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:51.722657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9cd2a83-8104-4f28-8c27-a6a43029f050 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:51.723087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9cd2a83-8104-4f28-8c27-a6a43029f050 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:51.852683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e9cd2a83-8104-4f28-8c27-a6a43029f050 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:51.860990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e9cd2a83-8104-4f28-8c27-a6a43029f050 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.150773 Jun 02 16:12:51.861549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 349/694] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:51 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:52.878138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0b917067-9f2f-4126-b086-3de1bc20eb40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:52.878755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0b917067-9f2f-4126-b086-3de1bc20eb40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:52.881292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=52 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:52.885990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b917067-9f2f-4126-b086-3de1bc20eb40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:52.886470 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b917067-9f2f-4126-b086-3de1bc20eb40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:52.887894 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b917067-9f2f-4126-b086-3de1bc20eb40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:52.888327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b917067-9f2f-4126-b086-3de1bc20eb40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:53.019467 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0b917067-9f2f-4126-b086-3de1bc20eb40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:53.027571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0b917067-9f2f-4126-b086-3de1bc20eb40 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.153215 Jun 02 16:12:53.029999 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 346/695] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:52 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:54.045119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-74807889-da3e-46b2-9e65-f8de1f8b0538 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:54.045763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-74807889-da3e-46b2-9e65-f8de1f8b0538 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:54.052253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74807889-da3e-46b2-9e65-f8de1f8b0538 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:54.052725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74807889-da3e-46b2-9e65-f8de1f8b0538 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:54.053473 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74807889-da3e-46b2-9e65-f8de1f8b0538 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:54.053911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74807889-da3e-46b2-9e65-f8de1f8b0538 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:54.183133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-74807889-da3e-46b2-9e65-f8de1f8b0538 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:54.192189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-74807889-da3e-46b2-9e65-f8de1f8b0538 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.150958 Jun 02 16:12:54.192761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 350/696] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:54 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:55.208989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f0cf952c-4ee6-494f-8bd2-714dc21b0508 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:55.209595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f0cf952c-4ee6-494f-8bd2-714dc21b0508 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:55.216624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0cf952c-4ee6-494f-8bd2-714dc21b0508 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:55.217066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0cf952c-4ee6-494f-8bd2-714dc21b0508 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:55.217830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0cf952c-4ee6-494f-8bd2-714dc21b0508 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:55.218628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0cf952c-4ee6-494f-8bd2-714dc21b0508 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:55.350647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f0cf952c-4ee6-494f-8bd2-714dc21b0508 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:55.358706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f0cf952c-4ee6-494f-8bd2-714dc21b0508 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.153544 Jun 02 16:12:55.359321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 347/697] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:55 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:56.375793 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-23041226-144c-4a7d-a229-40ddccc7047f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:56.376399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-23041226-144c-4a7d-a229-40ddccc7047f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:56.382905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23041226-144c-4a7d-a229-40ddccc7047f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:56.383347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23041226-144c-4a7d-a229-40ddccc7047f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:56.384096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23041226-144c-4a7d-a229-40ddccc7047f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:56.384525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23041226-144c-4a7d-a229-40ddccc7047f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:56.512356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-23041226-144c-4a7d-a229-40ddccc7047f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:56.520447 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-23041226-144c-4a7d-a229-40ddccc7047f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.148416 Jun 02 16:12:56.521002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 351/698] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:56 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:57.538471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-65f9282c-f594-4523-9bbd-5faece722b48 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:57.539086 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-65f9282c-f594-4523-9bbd-5faece722b48 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:57.546615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65f9282c-f594-4523-9bbd-5faece722b48 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:57.547064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65f9282c-f594-4523-9bbd-5faece722b48 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:57.547849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65f9282c-f594-4523-9bbd-5faece722b48 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:57.548308 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65f9282c-f594-4523-9bbd-5faece722b48 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:57.677561 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-65f9282c-f594-4523-9bbd-5faece722b48 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:57.686033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-65f9282c-f594-4523-9bbd-5faece722b48 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1736 microversion: 2.1 time: 0.151530 Jun 02 16:12:57.690844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 348/699] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:57 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:58.703287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a0c563df-0742-4705-b502-50d95b73d07e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:58.703896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a0c563df-0742-4705-b502-50d95b73d07e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:58.710516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a0c563df-0742-4705-b502-50d95b73d07e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:58.710966 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a0c563df-0742-4705-b502-50d95b73d07e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:58.711729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a0c563df-0742-4705-b502-50d95b73d07e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:58.712167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a0c563df-0742-4705-b502-50d95b73d07e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:58.844628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a0c563df-0742-4705-b502-50d95b73d07e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:58.852421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a0c563df-0742-4705-b502-50d95b73d07e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1716 microversion: 2.1 time: 0.153422 Jun 02 16:12:58.852973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 352/700] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:58 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:12:58.907094 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:58.907600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:58.914194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:58.914648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:58.915414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:58.915854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:58.998160 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] HTTP exception thrown: Cannot 'detach_volume' instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef while it is in vm_state rescued Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Request method failure captured: Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments/9f6280a1-4a3d-4aa7-837b-65498e77807e HTTP/1.1 Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOAO7LmHqb4S_f4qwkNYdaHIV121i5tIUgTvVzS00aYcMN7m5pOkeLk6zCuP0R6IV1y0MhhoRJeqYPLyhsXvbyg4WsnBPK6GU_Ip3YjrFLh8AS5JLVg_uIYrdxD1j654pRlGuETGhlXxCeeVYcAJWrmuY6ublaGdQg5AuSzUoIcy7hc Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:12:58.999770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_629a7b91ffc64154a55a45415f739949"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/629a7b91ffc64154a55a45415f739949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}] Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: a8658730ea2a4a06b7b4070976c6397f Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:12:59.001139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Cannot 'detach_volume' instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef while it is in vm_state rescued Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'server_id': '87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef', 'id': '9f6280a1-4a3d-4aa7-837b-65498e77807e'} Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:12:59.001814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef while it is in vm_state rescued Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef while it is in vm_state rescued Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:12:59.003223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Returning 409 to user: Cannot 'detach_volume' instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef while it is in vm_state rescued {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:12:59.004194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ac42d1ed-c1e0-4bc7-8310-1e611faeed49 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "DELETE /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments/9f6280a1-4a3d-4aa7-837b-65498e77807e" status: 409 len: 152 microversion: 2.1 time: 0.099182 Jun 02 16:12:59.004194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 349/701] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:12:58 2022] DELETE /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments/9f6280a1-4a3d-4aa7-837b-65498e77807e => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 02 16:12:59.009971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1f6fb7f8-c752-4502-a89f-fabb365ce6f2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:59.010518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1f6fb7f8-c752-4502-a89f-fabb365ce6f2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:59.016373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f6fb7f8-c752-4502-a89f-fabb365ce6f2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:59.016814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f6fb7f8-c752-4502-a89f-fabb365ce6f2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:59.017563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f6fb7f8-c752-4502-a89f-fabb365ce6f2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:59.017991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f6fb7f8-c752-4502-a89f-fabb365ce6f2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:59.288544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1f6fb7f8-c752-4502-a89f-fabb365ce6f2 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "POST /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/action" status: 202 len: 0 microversion: 2.1 time: 0.281926 Jun 02 16:12:59.292612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 353/702] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:12:59 2022] POST /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:12:59.299055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-40d091fe-3f69-4bf0-89e1-2dfebdc5ba53 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:12:59.300737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-40d091fe-3f69-4bf0-89e1-2dfebdc5ba53 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:59.308709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0a54dbaf-d1ee-4dbc-a841-75a7e4e0ddee tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1332151741"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:12:59.311705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0a54dbaf-d1ee-4dbc-a841-75a7e4e0ddee tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:12:59.316939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0a54dbaf-d1ee-4dbc-a841-75a7e4e0ddee tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:59.317452 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0a54dbaf-d1ee-4dbc-a841-75a7e4e0ddee tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:59.317667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40d091fe-3f69-4bf0-89e1-2dfebdc5ba53 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:59.317985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40d091fe-3f69-4bf0-89e1-2dfebdc5ba53 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:59.318266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0a54dbaf-d1ee-4dbc-a841-75a7e4e0ddee tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:59.318704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0a54dbaf-d1ee-4dbc-a841-75a7e4e0ddee tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:59.318827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40d091fe-3f69-4bf0-89e1-2dfebdc5ba53 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:12:59.319192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40d091fe-3f69-4bf0-89e1-2dfebdc5ba53 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:12:59.461604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-40d091fe-3f69-4bf0-89e1-2dfebdc5ba53 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:12:59.470574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-40d091fe-3f69-4bf0-89e1-2dfebdc5ba53 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1724 microversion: 2.1 time: 0.175977 Jun 02 16:12:59.471104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 354/703] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:12:59 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:12:59.500340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.network.security_group_api [None req-0a54dbaf-d1ee-4dbc-a841-75a7e4e0ddee tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Removing security group 38f8ebdf-4ca6-4cea-b87f-a39a338e16c3 from port f1a43f7e-70f3-4a67-af40-e30955976d64 Jun 02 16:13:00.280533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0a54dbaf-d1ee-4dbc-a841-75a7e4e0ddee tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "POST /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/action" status: 202 len: 0 microversion: 2.1 time: 1.080170 Jun 02 16:13:00.283677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 350/704] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:12:59 2022] POST /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/action => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 16:13:00.372352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-2e119803-d849-4c69-9651-fb1531751fae req-5d613ac9-a1e1-43dc-aea9-95599f7fcfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4649971-cb55-4c10-83c7-e0831c1d9a2b", "tag": "f1a43f7e-70f3-4a67-af40-e30955976d64"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:00.383291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-2e119803-d849-4c69-9651-fb1531751fae req-5d613ac9-a1e1-43dc-aea9-95599f7fcfc4 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:00.384048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-2e119803-d849-4c69-9651-fb1531751fae req-5d613ac9-a1e1-43dc-aea9-95599f7fcfc4 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:00.398051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-2e119803-d849-4c69-9651-fb1531751fae req-5d613ac9-a1e1-43dc-aea9-95599f7fcfc4 service nova] Creating event network-changed:f1a43f7e-70f3-4a67-af40-e30955976d64 for instance b4649971-cb55-4c10-83c7-e0831c1d9a2b on hv-cinder-79760 Jun 02 16:13:00.405579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-2e119803-d849-4c69-9651-fb1531751fae req-5d613ac9-a1e1-43dc-aea9-95599f7fcfc4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117808 Jun 02 16:13:00.407687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 355/705] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:13:00.488536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-eb134b0b-430a-424f-bc9b-63bae8e7917e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:00.489232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-eb134b0b-430a-424f-bc9b-63bae8e7917e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:00.498266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eb134b0b-430a-424f-bc9b-63bae8e7917e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:00.498266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eb134b0b-430a-424f-bc9b-63bae8e7917e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:00.498266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eb134b0b-430a-424f-bc9b-63bae8e7917e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:00.498266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eb134b0b-430a-424f-bc9b-63bae8e7917e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:00.501019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:00.684021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eb134b0b-430a-424f-bc9b-63bae8e7917e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:00.692409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-eb134b0b-430a-424f-bc9b-63bae8e7917e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1724 microversion: 2.1 time: 0.208016 Jun 02 16:13:00.703612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 351/706] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:00 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:13:01.506450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4e304f68-82e8-410f-96f7-4c35cfb23096 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:01.511748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-b331a20a-6694-4bda-af31-7696ea2e7091 req-0482d17e-c8b0-423b-a5c2-3b0cc21756e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4649971-cb55-4c10-83c7-e0831c1d9a2b", "tag": "f1a43f7e-70f3-4a67-af40-e30955976d64"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:01.512908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4e304f68-82e8-410f-96f7-4c35cfb23096 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:01.519353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e304f68-82e8-410f-96f7-4c35cfb23096 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:01.519797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e304f68-82e8-410f-96f7-4c35cfb23096 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:01.520565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e304f68-82e8-410f-96f7-4c35cfb23096 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:01.521065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e304f68-82e8-410f-96f7-4c35cfb23096 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:01.523576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-b331a20a-6694-4bda-af31-7696ea2e7091 req-0482d17e-c8b0-423b-a5c2-3b0cc21756e8 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:01.524101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-b331a20a-6694-4bda-af31-7696ea2e7091 req-0482d17e-c8b0-423b-a5c2-3b0cc21756e8 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:01.538495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-b331a20a-6694-4bda-af31-7696ea2e7091 req-0482d17e-c8b0-423b-a5c2-3b0cc21756e8 service nova] Creating event network-changed:f1a43f7e-70f3-4a67-af40-e30955976d64 for instance b4649971-cb55-4c10-83c7-e0831c1d9a2b on hv-cinder-79760 Jun 02 16:13:01.544080 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-b331a20a-6694-4bda-af31-7696ea2e7091 req-0482d17e-c8b0-423b-a5c2-3b0cc21756e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035866 Jun 02 16:13:01.544686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 352/707] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:01.648281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-4e304f68-82e8-410f-96f7-4c35cfb23096 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lazy-loading 'services' on Instance uuid b4649971-cb55-4c10-83c7-e0831c1d9a2b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:13:01.712207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-06d5f9c0-cc44-4c69-b9e4-8d6799fe0747 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:01.713172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-06d5f9c0-cc44-4c69-b9e4-8d6799fe0747 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:01.721513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06d5f9c0-cc44-4c69-b9e4-8d6799fe0747 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:01.722099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06d5f9c0-cc44-4c69-b9e4-8d6799fe0747 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:01.723167 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06d5f9c0-cc44-4c69-b9e4-8d6799fe0747 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:01.723740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06d5f9c0-cc44-4c69-b9e4-8d6799fe0747 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:01.814273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:01.864135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-06d5f9c0-cc44-4c69-b9e4-8d6799fe0747 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:01.874788 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-06d5f9c0-cc44-4c69-b9e4-8d6799fe0747 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1724 microversion: 2.1 time: 0.165055 Jun 02 16:13:01.874788 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 353/708] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:01 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:13:01.937022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4e304f68-82e8-410f-96f7-4c35cfb23096 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments/05008caa-d111-4aa0-b820-cc0a057fe407" status: 202 len: 0 microversion: 2.1 time: 0.435347 Jun 02 16:13:01.937613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 356/709] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:13:01 2022] DELETE /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments/05008caa-d111-4aa0-b820-cc0a057fe407 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:13:01.946067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5a70e40e-08e9-4328-ae97-de4a049b3102 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:01.947034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5a70e40e-08e9-4328-ae97-de4a049b3102 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:01.953560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a70e40e-08e9-4328-ae97-de4a049b3102 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:01.954014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a70e40e-08e9-4328-ae97-de4a049b3102 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:01.954859 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a70e40e-08e9-4328-ae97-de4a049b3102 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:01.955298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a70e40e-08e9-4328-ae97-de4a049b3102 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:01.983813 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5a70e40e-08e9-4328-ae97-de4a049b3102 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041743 Jun 02 16:13:01.984386 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 354/710] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:13:01 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:02.892070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8ddc626e-54a3-41f6-8cc0-9e27ea8aae83 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:02.892737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8ddc626e-54a3-41f6-8cc0-9e27ea8aae83 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:02.899863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddc626e-54a3-41f6-8cc0-9e27ea8aae83 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:02.900328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddc626e-54a3-41f6-8cc0-9e27ea8aae83 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:02.901097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddc626e-54a3-41f6-8cc0-9e27ea8aae83 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:02.901538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddc626e-54a3-41f6-8cc0-9e27ea8aae83 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:02.996418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-999d1a88-edfd-4134-9c53-562defa3be1a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:02.997105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-999d1a88-edfd-4134-9c53-562defa3be1a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:03.003747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-999d1a88-edfd-4134-9c53-562defa3be1a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:03.004272 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-999d1a88-edfd-4134-9c53-562defa3be1a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:03.004936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-999d1a88-edfd-4134-9c53-562defa3be1a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:03.005401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-999d1a88-edfd-4134-9c53-562defa3be1a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:03.037116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-999d1a88-edfd-4134-9c53-562defa3be1a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Jun 02 16:13:03.037837 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 355/711] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:13:02 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:13:03.049067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8ddc626e-54a3-41f6-8cc0-9e27ea8aae83 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:03.057877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8ddc626e-54a3-41f6-8cc0-9e27ea8aae83 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1724 microversion: 2.1 time: 0.171475 Jun 02 16:13:03.058524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 357/712] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:02 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:13:04.048923 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6cb1df5a-3fa5-4ee2-a43a-77257f87fa9b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:04.049747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6cb1df5a-3fa5-4ee2-a43a-77257f87fa9b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:04.056192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6cb1df5a-3fa5-4ee2-a43a-77257f87fa9b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:04.056655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6cb1df5a-3fa5-4ee2-a43a-77257f87fa9b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:04.057400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6cb1df5a-3fa5-4ee2-a43a-77257f87fa9b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:04.057832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6cb1df5a-3fa5-4ee2-a43a-77257f87fa9b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:04.075064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-37437711-5e33-4626-a4c6-31fd254d682f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:04.076449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-37437711-5e33-4626-a4c6-31fd254d682f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:04.083001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37437711-5e33-4626-a4c6-31fd254d682f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:04.083470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37437711-5e33-4626-a4c6-31fd254d682f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:04.084230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37437711-5e33-4626-a4c6-31fd254d682f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:04.084677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37437711-5e33-4626-a4c6-31fd254d682f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:04.088992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6cb1df5a-3fa5-4ee2-a43a-77257f87fa9b tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Jun 02 16:13:04.093035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 356/713] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:13:04 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:04.221812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-37437711-5e33-4626-a4c6-31fd254d682f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:04.229723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-37437711-5e33-4626-a4c6-31fd254d682f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1730 microversion: 2.1 time: 0.158460 Jun 02 16:13:04.231726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 358/714] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:04 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:13:04.246608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ac3375fa-a901-40a0-8698-e83d20ea1097 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:04.247711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ac3375fa-a901-40a0-8698-e83d20ea1097 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:04.253768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac3375fa-a901-40a0-8698-e83d20ea1097 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:04.254257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac3375fa-a901-40a0-8698-e83d20ea1097 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:04.255021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac3375fa-a901-40a0-8698-e83d20ea1097 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:04.255498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac3375fa-a901-40a0-8698-e83d20ea1097 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:04.332058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ac3375fa-a901-40a0-8698-e83d20ea1097 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089315 Jun 02 16:13:04.332853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 357/715] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 2 16:13:04 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:05.101075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e1654f1a-6f6d-4899-a6cb-55257d8eb200 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:05.102216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e1654f1a-6f6d-4899-a6cb-55257d8eb200 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:05.109002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1654f1a-6f6d-4899-a6cb-55257d8eb200 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:05.109502 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1654f1a-6f6d-4899-a6cb-55257d8eb200 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:05.110242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1654f1a-6f6d-4899-a6cb-55257d8eb200 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:05.110675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1654f1a-6f6d-4899-a6cb-55257d8eb200 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:05.142576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e1654f1a-6f6d-4899-a6cb-55257d8eb200 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045415 Jun 02 16:13:05.143471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 359/716] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:13:05 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 16:13:05.154437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:05.155702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:05.171922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:05.171922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:05.171922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:05.171922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:05.255122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] HTTP exception thrown: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b is not attached to volume 05008caa-d111-4aa0-b820-cc0a057fe407 Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Request method failure captured: Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments/05008caa-d111-4aa0-b820-cc0a057fe407 HTTP/1.1 Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOBRrCOk1nwXcuyKeHccfCJXXl2mTFS7SjBZiEjThpRYkrtNnSNaSqx99NmOR0gMyZIBc9-pc8Csv267YatddNFfdS7tZO-FHr0qGveV8YsIa51uYIQsTJLAfJQPnQ0l-t2-LepZWtArrJ5ofznltH4-G9zuW5DwG_-OpTC9knvjsMI Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: b9ae3e4e2fa943d497623a549e23f906 Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-TestMinimumBasicScenario-1680873820 Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:13:05.271597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b9ae3e4e2fa943d497623a549e23f906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b9ae3e4e2fa943d497623a549e23f906"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b9ae3e4e2fa943d497623a549e23f906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b9ae3e4e2fa943d497623a549e23f906"}]}] Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-TestMinimumBasicScenario-1680873820 Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: b9ae3e4e2fa943d497623a549e23f906 Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1680873820 Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-TestMinimumBasicScenario-1680873820-project Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 88d362d24ff54106b00d945599f2a61d Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-TestMinimumBasicScenario-1680873820-project Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:13:05.272993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b is not attached to volume 05008caa-d111-4aa0-b820-cc0a057fe407 Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'server_id': 'b4649971-cb55-4c10-83c7-e0831c1d9a2b', 'id': '05008caa-d111-4aa0-b820-cc0a057fe407'} Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 05008caa-d111-4aa0-b820-cc0a057fe407. Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:13:05.273678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b is not attached to volume 05008caa-d111-4aa0-b820-cc0a057fe407 Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b is not attached to volume 05008caa-d111-4aa0-b820-cc0a057fe407 Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:13:05.274830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Returning 404 to user: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b is not attached to volume 05008caa-d111-4aa0-b820-cc0a057fe407 {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:13:05.275970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-72ab0f9c-1971-47af-8ef1-da13e75142c6 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments/05008caa-d111-4aa0-b820-cc0a057fe407" status: 404 len: 154 microversion: 2.1 time: 0.123933 Jun 02 16:13:05.275970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 358/717] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:13:05 2022] DELETE /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b/os-volume_attachments/05008caa-d111-4aa0-b820-cc0a057fe407 => generated 154 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:13:05.333340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-4171013a-5b6a-4269-9eb3-682e8f97b972 req-ce930b5e-bb01-448b-8cf2-28c3835b75b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef", "tag": "3c38464f-673f-4bd1-9857-db6554c37dd9"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:05.343185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-4171013a-5b6a-4269-9eb3-682e8f97b972 req-ce930b5e-bb01-448b-8cf2-28c3835b75b4 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:05.346443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-4171013a-5b6a-4269-9eb3-682e8f97b972 req-ce930b5e-bb01-448b-8cf2-28c3835b75b4 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:05.355919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-4171013a-5b6a-4269-9eb3-682e8f97b972 req-ce930b5e-bb01-448b-8cf2-28c3835b75b4 service nova] Creating event network-changed:3c38464f-673f-4bd1-9857-db6554c37dd9 for instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef on hv-cinder-79760 Jun 02 16:13:05.365640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-4171013a-5b6a-4269-9eb3-682e8f97b972 req-ce930b5e-bb01-448b-8cf2-28c3835b75b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035852 Jun 02 16:13:05.366314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 360/718] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:06.557053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cc244bfc-9b0d-4da0-86da-bb3ebb22754c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:06.557570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cc244bfc-9b0d-4da0-86da-bb3ebb22754c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:06.565635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc244bfc-9b0d-4da0-86da-bb3ebb22754c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:06.567459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc244bfc-9b0d-4da0-86da-bb3ebb22754c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:06.567459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc244bfc-9b0d-4da0-86da-bb3ebb22754c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:06.567459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc244bfc-9b0d-4da0-86da-bb3ebb22754c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:06.592415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cc244bfc-9b0d-4da0-86da-bb3ebb22754c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Going to try to terminate instance {{(pid=118257) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:13:06.922914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cc244bfc-9b0d-4da0-86da-bb3ebb22754c tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 204 len: 0 microversion: 2.1 time: 0.369879 Jun 02 16:13:06.923514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 359/719] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:13:06 2022] DELETE /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:13:06.932951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-37999077-c2a3-4e5b-ac7d-ebbf231db221 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:06.933675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-37999077-c2a3-4e5b-ac7d-ebbf231db221 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:06.940208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37999077-c2a3-4e5b-ac7d-ebbf231db221 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:06.942533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37999077-c2a3-4e5b-ac7d-ebbf231db221 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:06.942533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37999077-c2a3-4e5b-ac7d-ebbf231db221 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:06.942533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37999077-c2a3-4e5b-ac7d-ebbf231db221 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:07.070065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-37999077-c2a3-4e5b-ac7d-ebbf231db221 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:07.078183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-37999077-c2a3-4e5b-ac7d-ebbf231db221 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1554 microversion: 2.1 time: 0.149955 Jun 02 16:13:07.078742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 361/720] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:06 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:13:07.380762 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-9fda1015-0dc5-46ce-bb66-0cde9f7db3a7 req-7259e1f7-b718-4f8d-a7b8-bab58342452a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef", "tag": "3c38464f-673f-4bd1-9857-db6554c37dd9"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:07.389591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-9fda1015-0dc5-46ce-bb66-0cde9f7db3a7 req-7259e1f7-b718-4f8d-a7b8-bab58342452a service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:07.390031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-9fda1015-0dc5-46ce-bb66-0cde9f7db3a7 req-7259e1f7-b718-4f8d-a7b8-bab58342452a service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:07.400714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-9fda1015-0dc5-46ce-bb66-0cde9f7db3a7 req-7259e1f7-b718-4f8d-a7b8-bab58342452a service nova] Creating event network-changed:3c38464f-673f-4bd1-9857-db6554c37dd9 for instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef on hv-cinder-79760 Jun 02 16:13:07.406538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-9fda1015-0dc5-46ce-bb66-0cde9f7db3a7 req-7259e1f7-b718-4f8d-a7b8-bab58342452a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029778 Jun 02 16:13:07.407109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 360/721] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:08.096726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1061d81a-81ab-4622-944c-d4437c55be5a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:08.097337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1061d81a-81ab-4622-944c-d4437c55be5a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:08.103814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1061d81a-81ab-4622-944c-d4437c55be5a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:08.104268 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1061d81a-81ab-4622-944c-d4437c55be5a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:08.105059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1061d81a-81ab-4622-944c-d4437c55be5a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:08.105545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1061d81a-81ab-4622-944c-d4437c55be5a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:08.243381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1061d81a-81ab-4622-944c-d4437c55be5a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:08.250832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1061d81a-81ab-4622-944c-d4437c55be5a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1554 microversion: 2.1 time: 0.159218 Jun 02 16:13:08.251385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 362/722] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:08 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:13:09.269847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b97677ad-9a4f-4e26-b6cb-c72be6a33527 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:09.270495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b97677ad-9a4f-4e26-b6cb-c72be6a33527 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:09.276693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b97677ad-9a4f-4e26-b6cb-c72be6a33527 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:09.277134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b97677ad-9a4f-4e26-b6cb-c72be6a33527 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:09.277895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b97677ad-9a4f-4e26-b6cb-c72be6a33527 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:09.278355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b97677ad-9a4f-4e26-b6cb-c72be6a33527 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:09.484741 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b97677ad-9a4f-4e26-b6cb-c72be6a33527 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:09.492318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b97677ad-9a4f-4e26-b6cb-c72be6a33527 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1554 microversion: 2.1 time: 0.228164 Jun 02 16:13:09.493082 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 361/723] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:09 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:13:09.955993 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-7c6f7a54-2859-43eb-8e13-a027af7a2934 req-70e17f2b-684b-48b0-a4f4-f8e270bea0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4649971-cb55-4c10-83c7-e0831c1d9a2b", "name": "network-vif-deleted", "tag": "f1a43f7e-70f3-4a67-af40-e30955976d64"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:09.964101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-7c6f7a54-2859-43eb-8e13-a027af7a2934 req-70e17f2b-684b-48b0-a4f4-f8e270bea0a2 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:09.965211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-7c6f7a54-2859-43eb-8e13-a027af7a2934 req-70e17f2b-684b-48b0-a4f4-f8e270bea0a2 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:09.976044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-7c6f7a54-2859-43eb-8e13-a027af7a2934 req-70e17f2b-684b-48b0-a4f4-f8e270bea0a2 service nova] Creating event network-vif-deleted:f1a43f7e-70f3-4a67-af40-e30955976d64 for instance b4649971-cb55-4c10-83c7-e0831c1d9a2b on hv-cinder-79760 Jun 02 16:13:09.980951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-7c6f7a54-2859-43eb-8e13-a027af7a2934 req-70e17f2b-684b-48b0-a4f4-f8e270bea0a2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028572 Jun 02 16:13:09.981526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 363/724] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:10.509944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:10.511229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:10.518356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:10.518819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:10.519574 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:10.520006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:10.549486 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:10.549934 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:10.550416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lazy-loading 'fault' on Instance uuid b4649971-cb55-4c10-83c7-e0831c1d9a2b {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:13:10.596241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d362d24ff54106b00d945599f2a61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ae3e4e2fa943d497623a549e23f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:10.603651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4ba1b579-2e58-4ae7-90c5-8755acd8ef7d tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 200 len: 1348 microversion: 2.1 time: 0.097590 Jun 02 16:13:10.604224 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 362/725] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:10 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:13:10.846123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:13:10.846337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:13:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:13:11.621922 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:11.622579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] [instance: b4649971-cb55-4c10-83c7-e0831c1d9a2b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:11.631876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:11.632325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:11.633123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:11.633555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:11.647238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] HTTP exception thrown: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b could not be found. Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Request method failure captured: Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b HTTP/1.1 Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOBRrCOk1nwXcuyKeHccfCJXXl2mTFS7SjBZiEjThpRYkrtNnSNaSqx99NmOR0gMyZIBc9-pc8Csv267YatddNFfdS7tZO-FHr0qGveV8YsIa51uYIQsTJLAfJQPnQ0l-t2-LepZWtArrJ5ofznltH4-G9zuW5DwG_-OpTC9knvjsMI Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: b9ae3e4e2fa943d497623a549e23f906 Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-TestMinimumBasicScenario-1680873820 Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:13:11.649053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b9ae3e4e2fa943d497623a549e23f906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b9ae3e4e2fa943d497623a549e23f906"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b9ae3e4e2fa943d497623a549e23f906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b9ae3e4e2fa943d497623a549e23f906"}]}] Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-TestMinimumBasicScenario-1680873820 Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: b9ae3e4e2fa943d497623a549e23f906 Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1680873820 Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-TestMinimumBasicScenario-1680873820-project Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 88d362d24ff54106b00d945599f2a61d Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-TestMinimumBasicScenario-1680873820-project Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b could not be found. Jun 02 16:13:11.650451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': 'b4649971-cb55-4c10-83c7-e0831c1d9a2b'} Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b could not be found. Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:13:11.651388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b could not be found. Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b could not be found. Jun 02 16:13:11.652921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:11.654416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Returning 404 to user: Instance b4649971-cb55-4c10-83c7-e0831c1d9a2b could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:13:11.654416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-be72b1ca-1a25-4fad-aee6-cff4ac441593 tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b" status: 404 len: 111 microversion: 2.1 time: 0.033339 Jun 02 16:13:11.654416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 364/726] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:11 2022] GET /compute/v2.1/servers/b4649971-cb55-4c10-83c7-e0831c1d9a2b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:13:11.659806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9f9a7e2a-44a9-44ef-a46c-243f7818ff2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] Calling method '.version_select at 0x7f2d5c116670>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:11.751924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9f9a7e2a-44a9-44ef-a46c-243f7818ff2a tempest-TestMinimumBasicScenario-1680873820 tempest-TestMinimumBasicScenario-1680873820-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1798691851" status: 202 len: 0 microversion: 2.1 time: 0.096505 Jun 02 16:13:11.752666 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 363/727] 10.222.0.59 () {58 vars in 1271 bytes} [Thu Jun 2 16:13:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1798691851 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:13:12.340147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:13:12.340350 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:13:36.265514 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=33 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:36.266432 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=36 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:36.454240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-57a714cc-0d38-40b3-9599-43b6de12a4c6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Action: 'create', calling method: .version_select at 0x7f2d60d97f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1652600266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCr8mmqBB9QGOBVlHuxz5CQd2IoMg4y3eCbOnF/jS9CvvefGpm9DjaIN6Z7AAPEb1vg0Gw85bNHEFee+H23icUbfJKmof/I6PvFt2cldOOTb4zjou3XG5LEt3YuLrGWMFw=="}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:36.468689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-57a714cc-0d38-40b3-9599-43b6de12a4c6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Getting quotas for project 460ea33e74e8480c8b70c8123e81e4c4. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:13:36.473125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-57a714cc-0d38-40b3-9599-43b6de12a4c6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Getting quotas for user 5d2ef2aa9b8c46cfb198bd18a5944a85 and project 460ea33e74e8480c8b70c8123e81e4c4. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:13:36.576503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-57a714cc-0d38-40b3-9599-43b6de12a4c6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.315215 Jun 02 16:13:36.580293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 365/728] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 2 16:13:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:38.610665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:38.611395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:38.734348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d012b9f2-723b-4885-a664-78b49cf0129a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:38.734864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d012b9f2-723b-4885-a664-78b49cf0129a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:38.747027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d012b9f2-723b-4885-a664-78b49cf0129a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:38.747476 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d012b9f2-723b-4885-a664-78b49cf0129a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:38.749832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d012b9f2-723b-4885-a664-78b49cf0129a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:38.750322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d012b9f2-723b-4885-a664-78b49cf0129a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:38.791994 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d012b9f2-723b-4885-a664-78b49cf0129a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments/87a67192-8bf8-4cb6-a8ab-9b51fa9b26a5" status: 200 len: 194 microversion: 2.20 time: 0.186287 Jun 02 16:13:38.797706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 364/729] 10.222.0.59 () {60 vars in 1453 bytes} [Thu Jun 2 16:13:38 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments/87a67192-8bf8-4cb6-a8ab-9b51fa9b26a5 => generated 194 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:13:38.861736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d9b3c4d9-321b-4d2b-8ef6-855111317df7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:38.862317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d9b3c4d9-321b-4d2b-8ef6-855111317df7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:38.878488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9b3c4d9-321b-4d2b-8ef6-855111317df7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:38.879632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9b3c4d9-321b-4d2b-8ef6-855111317df7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:38.880915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9b3c4d9-321b-4d2b-8ef6-855111317df7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:38.881429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9b3c4d9-321b-4d2b-8ef6-855111317df7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:38.967070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-d9b3c4d9-321b-4d2b-8ef6-855111317df7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lazy-loading 'services' on Instance uuid f8bf99ae-5d36-4add-b49f-746e933e19cc {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:13:39.216959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d9b3c4d9-321b-4d2b-8ef6-855111317df7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments/87a67192-8bf8-4cb6-a8ab-9b51fa9b26a5" status: 202 len: 0 microversion: 2.20 time: 0.358872 Jun 02 16:13:39.221927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 366/730] 10.222.0.59 () {60 vars in 1456 bytes} [Thu Jun 2 16:13:38 2022] DELETE /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments/87a67192-8bf8-4cb6-a8ab-9b51fa9b26a5 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:13:39.234067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cf1cdb97-6a0c-4bfd-82f6-be3467438c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:39.235487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cf1cdb97-6a0c-4bfd-82f6-be3467438c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:39.246153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf1cdb97-6a0c-4bfd-82f6-be3467438c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:39.247001 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf1cdb97-6a0c-4bfd-82f6-be3467438c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:39.248237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf1cdb97-6a0c-4bfd-82f6-be3467438c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:39.248842 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf1cdb97-6a0c-4bfd-82f6-be3467438c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:39.287858 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cf1cdb97-6a0c-4bfd-82f6-be3467438c45 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060684 Jun 02 16:13:39.291982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 365/731] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jun 2 16:13:39 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:13:40.302047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cfd5b523-bef9-49e5-bb36-c62ea6b183b5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:40.303184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cfd5b523-bef9-49e5-bb36-c62ea6b183b5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:40.309753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cfd5b523-bef9-49e5-bb36-c62ea6b183b5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:40.310247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cfd5b523-bef9-49e5-bb36-c62ea6b183b5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:40.311112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cfd5b523-bef9-49e5-bb36-c62ea6b183b5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:40.311573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cfd5b523-bef9-49e5-bb36-c62ea6b183b5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:40.341300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cfd5b523-bef9-49e5-bb36-c62ea6b183b5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045022 Jun 02 16:13:40.345935 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 367/732] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jun 2 16:13:40 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:13:41.353644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-39dfec25-9c1a-4c23-a4ef-566f7f5e7ab7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:41.354613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-39dfec25-9c1a-4c23-a4ef-566f7f5e7ab7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:41.362236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-39dfec25-9c1a-4c23-a4ef-566f7f5e7ab7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:41.363189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-39dfec25-9c1a-4c23-a4ef-566f7f5e7ab7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:41.363942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-39dfec25-9c1a-4c23-a4ef-566f7f5e7ab7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:41.364371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-39dfec25-9c1a-4c23-a4ef-566f7f5e7ab7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:41.393724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-39dfec25-9c1a-4c23-a4ef-566f7f5e7ab7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043987 Jun 02 16:13:41.394458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 366/733] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jun 2 16:13:41 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:13:41.462261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3c7bb8fb-5dd4-4c0f-b4e4-d74104b0ef20 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:41.462797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3c7bb8fb-5dd4-4c0f-b4e4-d74104b0ef20 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:41.469343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c7bb8fb-5dd4-4c0f-b4e4-d74104b0ef20 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:41.469786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c7bb8fb-5dd4-4c0f-b4e4-d74104b0ef20 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:41.470599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c7bb8fb-5dd4-4c0f-b4e4-d74104b0ef20 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:41.471028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c7bb8fb-5dd4-4c0f-b4e4-d74104b0ef20 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:41.496135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3c7bb8fb-5dd4-4c0f-b4e4-d74104b0ef20 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:13:41.815896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3c7bb8fb-5dd4-4c0f-b4e4-d74104b0ef20 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 204 len: 0 microversion: 2.20 time: 0.356980 Jun 02 16:13:41.816408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 368/734] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jun 2 16:13:41 2022] DELETE /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 16:13:41.824651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:41.825256 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:41.831254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:41.831759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:41.832517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:41.832953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:41.967137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:41.975887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:41.977377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:41.978547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6562e5de-aeb3-4233-a945-842868311f9d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.157763 Jun 02 16:13:41.979103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 367/735] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:41 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:42.999245 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:42.999944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:43.007525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:43.007976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:43.008767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:43.009267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:43.148655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:43.156631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:43.158156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:43.159306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4e9c9f33-8132-46b9-9974-f79901302c25 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.164536 Jun 02 16:13:43.160137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 369/736] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:42 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:44.179236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:44.179941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:44.189074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:44.189074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:44.189074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:44.189437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:44.328532 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:44.337016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:44.338611 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:44.339760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-01a70b65-380d-413f-a660-962bd56dc3c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1721 microversion: 2.20 time: 0.165986 Jun 02 16:13:44.340313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 368/737] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:44 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:45.104788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-e32d7ffa-6d75-45bf-b90d-8ccde38395d3 req-bfa8c361-6cdd-4e06-a36d-59041226a67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bf99ae-5d36-4add-b49f-746e933e19cc", "name": "network-vif-deleted", "tag": "95689152-b643-4d84-9f69-18b1c5d87d13"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:45.115310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-e32d7ffa-6d75-45bf-b90d-8ccde38395d3 req-bfa8c361-6cdd-4e06-a36d-59041226a67a service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:45.115753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-e32d7ffa-6d75-45bf-b90d-8ccde38395d3 req-bfa8c361-6cdd-4e06-a36d-59041226a67a service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:45.127145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-e32d7ffa-6d75-45bf-b90d-8ccde38395d3 req-bfa8c361-6cdd-4e06-a36d-59041226a67a service nova] Creating event network-vif-deleted:95689152-b643-4d84-9f69-18b1c5d87d13 for instance f8bf99ae-5d36-4add-b49f-746e933e19cc on hv-cinder-79760 Jun 02 16:13:45.133362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-e32d7ffa-6d75-45bf-b90d-8ccde38395d3 req-bfa8c361-6cdd-4e06-a36d-59041226a67a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032348 Jun 02 16:13:45.134206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 370/738] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:45.359172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:45.359888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:45.367595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:45.368048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:45.368826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:45.369266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:45.434257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:45.443566 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:45.445087 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:45.447046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c7b17f97-a49f-4f8d-8948-1ec2f043e1ce tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 200 len: 1364 microversion: 2.20 time: 0.091191 Jun 02 16:13:45.447046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 369/739] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:45 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 1364 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:46.464825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:46.465534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:46.472759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:46.473207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:46.477238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:46.477238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:46.488494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=4 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:46.490140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] HTTP exception thrown: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Request method failure captured: Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc HTTP/1.1 Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOBfxS4cclfKx3-RndKo8Dh-CNumTLJ_9ppQhQQxKyMPB4EEBU5GFxYA9-LhBrKjDNTyWY87gQZT1pZartY-1sBtFZIfC7qCMEO9Vkk6hprpWxRiJCu0PbwNFMbxNPkdwvsf8s6P7LrQQqRis9Yox-jWNZMH13qPm6c5jIeo1Wfiw4g Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:13:46.491728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}] Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 95108cdd8e134be3823d5024f7037b3e Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:13:46.493359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': 'f8bf99ae-5d36-4add-b49f-746e933e19cc'} Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:13:46.494234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:13:46.495687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:13:46.496990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Returning 404 to user: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:13:46.496990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-263c37cc-ce32-490f-9a9f-6b5059ee5473 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 404 len: 111 microversion: 2.20 time: 0.032763 Jun 02 16:13:46.496990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 371/740] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:46 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:13:46.501831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-704ea6c9-fa8d-4c14-83a6-623d1dc452d5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '.version_select at 0x7f2d5c116c10>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:46.553742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-704ea6c9-fa8d-4c14-83a6-623d1dc452d5 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283040103" status: 204 len: 0 microversion: 2.20 time: 0.055634 Jun 02 16:13:46.554346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 370/741] 10.222.0.59 () {60 vars in 1258 bytes} [Thu Jun 2 16:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283040103 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 16:13:47.423905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0ab3256d-8d2d-47b2-9d8b-91afbeac8597 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'create', calling method: .version_select at 0x7f2d60c8c040>, body: {"keypair": {"name": "tempest-keypair-1025566890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVASFbFjxNIrSBZQEiSZQPpFpCW6v0xAPG9D923bvdLGiOE8zxfvkYPQYTP1aU7xQPzD04wbQu1+iyXieM/d9ooNwthchYI30JBgVH/kHdBxyjazsj+iQLQADoRAgh1nA=="}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:47.439835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-0ab3256d-8d2d-47b2-9d8b-91afbeac8597 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Getting quotas for project 470abf75f36f4a84b9382efc2aa2fc1c. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:13:47.445036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-0ab3256d-8d2d-47b2-9d8b-91afbeac8597 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Getting quotas for user 95108cdd8e134be3823d5024f7037b3e and project 470abf75f36f4a84b9382efc2aa2fc1c. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:13:47.577120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0ab3256d-8d2d-47b2-9d8b-91afbeac8597 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.156959 Jun 02 16:13:47.577744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 372/742] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Jun 2 16:13:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 16:13:49.797198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1726490202", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b93d0ec-397d-4791-9a03-a5b57663e875"}], "security_groups": [{"name": "tempest-securitygroup--437166870"}], "key_name": "tempest-keypair-1025566890", "user_data": "}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:49.903422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] validate_networks() for [('0b93d0ec-397d-4791-9a03-a5b57663e875', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:13:50.286013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:13:50.286480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:13:50.286963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:13:50.287410 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:13:50.287826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:13:50.296789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:50.297241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:50.298050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:50.298519 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:50.316729 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Getting quotas for project 470abf75f36f4a84b9382efc2aa2fc1c. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:13:50.321126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Getting quotas for user 95108cdd8e134be3823d5024f7037b3e and project 470abf75f36f4a84b9382efc2aa2fc1c. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:13:50.333524 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:13:50.335803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:13:50.452194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b2cee9cb-7260-46d7-be58-14957e695f78 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.659823 Jun 02 16:13:50.453039 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 371/743] 10.222.0.59 () {62 vars in 1187 bytes} [Thu Jun 2 16:13:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 16:13:50.464128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4264afff-b154-420f-bc18-4ad3eb928e53 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:50.464850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4264afff-b154-420f-bc18-4ad3eb928e53 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:50.529137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4264afff-b154-420f-bc18-4ad3eb928e53 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:50.537664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4264afff-b154-420f-bc18-4ad3eb928e53 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:50.539175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4264afff-b154-420f-bc18-4ad3eb928e53 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:50.540283 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4264afff-b154-420f-bc18-4ad3eb928e53 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1282 microversion: 2.20 time: 0.080529 Jun 02 16:13:50.540820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 373/744] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:50 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:51.564507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:51.565555 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:51.572815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:51.573394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:51.574263 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:51.574706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:51.641179 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:51.649422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:51.650950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:51.652044 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-07baee6a-9798-4e7a-9b01-d20cb9cb04d3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1286 microversion: 2.20 time: 0.095044 Jun 02 16:13:51.652600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 372/745] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:51 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:52.669689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:52.670446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:52.678362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:52.678621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:52.679474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:52.679995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:52.753353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:52.762301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:52.764662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:52.765228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f34876c2-00fb-4704-9f15-8fb40dda94ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1342 microversion: 2.20 time: 0.099207 Jun 02 16:13:52.765954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 374/746] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:52 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1342 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:53.785537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:53.786212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:53.792522 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:53.792979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:53.794083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:53.794538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:53.928587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:53.937274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:53.938946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:53.942188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b988921a-e8a7-484f-a4f2-993762c5abde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.159219 Jun 02 16:13:53.942188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 373/747] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:53 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:54.343764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-4e9ba609-2494-4497-bfd1-45c5a2cdf7e0 req-a1c5e0d4-ef5c-4321-9712-2b983fdeb965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942de225-4aff-4a9e-85f0-634ab0ac44e3", "tag": "97598fb5-567e-4cea-b72c-57887c16e355"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:54.353466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-4e9ba609-2494-4497-bfd1-45c5a2cdf7e0 req-a1c5e0d4-ef5c-4321-9712-2b983fdeb965 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:54.353924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-4e9ba609-2494-4497-bfd1-45c5a2cdf7e0 req-a1c5e0d4-ef5c-4321-9712-2b983fdeb965 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:54.366333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-4e9ba609-2494-4497-bfd1-45c5a2cdf7e0 req-a1c5e0d4-ef5c-4321-9712-2b983fdeb965 service nova] Creating event network-changed:97598fb5-567e-4cea-b72c-57887c16e355 for instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 on hv-cinder-79760 Jun 02 16:13:54.371555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-4e9ba609-2494-4497-bfd1-45c5a2cdf7e0 req-a1c5e0d4-ef5c-4321-9712-2b983fdeb965 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037421 Jun 02 16:13:54.372471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 375/748] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:13:54.958513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:54.959099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:54.965941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:54.966432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:54.967218 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:54.967654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:55.110558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:55.120590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:55.122153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:55.123295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ceadabda-ac7c-4510-92a0-a600fe17e0ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.169019 Jun 02 16:13:55.123851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 374/749] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:54 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:56.142682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:56.143407 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:56.149606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:56.150361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:56.151125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:56.151555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:56.280592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:56.289155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:56.290670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:56.291756 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f8dda1d3-6389-4c84-bd57-58085b39a046 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.153814 Jun 02 16:13:56.292298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 376/750] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:56 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:57.310908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:57.311495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:57.318143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:57.318593 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:57.319424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:57.319890 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:57.456701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:57.465571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:57.467099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:57.468201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f54c75fd-cf48-46f2-8703-39fb35a10b58 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.161338 Jun 02 16:13:57.468765 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 375/751] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:57 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:58.285195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e5fa853f-5394-42ff-8870-8895baa37ce0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:13:58.285747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e5fa853f-5394-42ff-8870-8895baa37ce0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:58.292197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5fa853f-5394-42ff-8870-8895baa37ce0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:58.292641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5fa853f-5394-42ff-8870-8895baa37ce0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:58.293386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5fa853f-5394-42ff-8870-8895baa37ce0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:58.293817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5fa853f-5394-42ff-8870-8895baa37ce0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:58.315243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-e5fa853f-5394-42ff-8870-8895baa37ce0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'flavor' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:13:58.487168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:58.487711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:58.494320 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:58.494773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:58.495570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:58.496004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:58.627502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:58.636245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:58.640135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:58.640135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ad6bc464-b32a-4bbc-9552-db50f938142b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.155713 Jun 02 16:13:58.640135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 376/752] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:58 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:13:58.646712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e5fa853f-5394-42ff-8870-8895baa37ce0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "POST /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b/action" status: 202 len: 0 microversion: 2.1 time: 0.365102 Jun 02 16:13:58.647291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 377/753] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:13:58 2022] POST /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 16:13:58.655274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-32a35eaf-14a9-4a53-9507-a9980f1c14b5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:58.655887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-32a35eaf-14a9-4a53-9507-a9980f1c14b5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:58.661875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-32a35eaf-14a9-4a53-9507-a9980f1c14b5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:58.662367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-32a35eaf-14a9-4a53-9507-a9980f1c14b5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:58.663131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-32a35eaf-14a9-4a53-9507-a9980f1c14b5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:58.663613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-32a35eaf-14a9-4a53-9507-a9980f1c14b5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:58.801664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-32a35eaf-14a9-4a53-9507-a9980f1c14b5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:58.809051 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-32a35eaf-14a9-4a53-9507-a9980f1c14b5 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.157552 Jun 02 16:13:58.809648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 377/754] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:58 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:13:59.657615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:59.658416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:59.666561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:59.667002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:59.667767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:59.668198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:59.806816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:59.815293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:59.817351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:59.818504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d0607bec-3749-4470-ba4e-f3aaf144c54d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.165369 Jun 02 16:13:59.819092 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 378/755] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:13:59 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:13:59.833188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-53571b1f-22fb-4db2-8763-fcb34d9fdb9e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:59.833806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-53571b1f-22fb-4db2-8763-fcb34d9fdb9e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:59.839970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-53571b1f-22fb-4db2-8763-fcb34d9fdb9e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:59.840419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-53571b1f-22fb-4db2-8763-fcb34d9fdb9e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:59.841192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-53571b1f-22fb-4db2-8763-fcb34d9fdb9e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:59.841629 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-53571b1f-22fb-4db2-8763-fcb34d9fdb9e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:59.974409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-53571b1f-22fb-4db2-8763-fcb34d9fdb9e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:13:59.974718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e0242ad4-f985-44d8-9ef5-1b0b877ba8db tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:13:59.975717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e0242ad4-f985-44d8-9ef5-1b0b877ba8db tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:13:59.981829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0242ad4-f985-44d8-9ef5-1b0b877ba8db tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:59.981985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-53571b1f-22fb-4db2-8763-fcb34d9fdb9e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.159386 Jun 02 16:13:59.982451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0242ad4-f985-44d8-9ef5-1b0b877ba8db tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:13:59.982739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 378/756] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:13:59 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:13:59.983368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0242ad4-f985-44d8-9ef5-1b0b877ba8db tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:13:59.983881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0242ad4-f985-44d8-9ef5-1b0b877ba8db tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:00.014013 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e0242ad4-f985-44d8-9ef5-1b0b877ba8db tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043932 Jun 02 16:14:00.014791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 379/757] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:13:59 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 16:14:00.081050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-060c9534-077d-4614-8fdf-eb85974e3782 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:00.081556 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-060c9534-077d-4614-8fdf-eb85974e3782 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:00.088230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-060c9534-077d-4614-8fdf-eb85974e3782 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:00.088684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-060c9534-077d-4614-8fdf-eb85974e3782 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:00.089458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-060c9534-077d-4614-8fdf-eb85974e3782 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:00.089899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-060c9534-077d-4614-8fdf-eb85974e3782 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:00.116033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-060c9534-077d-4614-8fdf-eb85974e3782 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Going to try to terminate instance {{(pid=118257) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:14:00.307274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:00.328633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=6 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:00.507182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-060c9534-077d-4614-8fdf-eb85974e3782 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "DELETE /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 204 len: 0 microversion: 2.1 time: 0.429664 Jun 02 16:14:00.507710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 379/758] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:14:00 2022] DELETE /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:14:00.516016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-36b030d8-ac4f-4476-9c4a-1dcf0690e9c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:00.516640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-36b030d8-ac4f-4476-9c4a-1dcf0690e9c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:00.522629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36b030d8-ac4f-4476-9c4a-1dcf0690e9c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:00.523126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36b030d8-ac4f-4476-9c4a-1dcf0690e9c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:00.524037 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36b030d8-ac4f-4476-9c4a-1dcf0690e9c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:00.524532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36b030d8-ac4f-4476-9c4a-1dcf0690e9c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:00.541224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=6 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:00.661297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-36b030d8-ac4f-4476-9c4a-1dcf0690e9c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:00.669276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-36b030d8-ac4f-4476-9c4a-1dcf0690e9c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1672 microversion: 2.1 time: 0.157334 Jun 02 16:14:00.669831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 380/759] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:00 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:00.837672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:00.838420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:00.846143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:00.846612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:00.848061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:00.848794 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:00.866860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:00.981093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:00.989145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:00.990690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:00.991786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d073193c-d748-49dd-8d2a-f0cfbb8afda7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.158497 Jun 02 16:14:00.992350 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 380/760] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:14:00 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:14:00.999450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cec5117c-8674-4ece-8ea6-c2317773bf82 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:01.004849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cec5117c-8674-4ece-8ea6-c2317773bf82 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:01.006155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cec5117c-8674-4ece-8ea6-c2317773bf82 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:01.006608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cec5117c-8674-4ece-8ea6-c2317773bf82 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:01.007367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cec5117c-8674-4ece-8ea6-c2317773bf82 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:01.007799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cec5117c-8674-4ece-8ea6-c2317773bf82 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:01.138254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cec5117c-8674-4ece-8ea6-c2317773bf82 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:01.146543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cec5117c-8674-4ece-8ea6-c2317773bf82 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.150821 Jun 02 16:14:01.147103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 381/761] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:00 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:01.686587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7a5e20e2-4fff-4b5f-a90c-4eec6252d745 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:01.687205 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7a5e20e2-4fff-4b5f-a90c-4eec6252d745 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:01.694465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7a5e20e2-4fff-4b5f-a90c-4eec6252d745 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:01.694936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7a5e20e2-4fff-4b5f-a90c-4eec6252d745 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:01.695682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7a5e20e2-4fff-4b5f-a90c-4eec6252d745 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:01.696118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7a5e20e2-4fff-4b5f-a90c-4eec6252d745 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:01.824353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7a5e20e2-4fff-4b5f-a90c-4eec6252d745 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:01.832124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7a5e20e2-4fff-4b5f-a90c-4eec6252d745 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1672 microversion: 2.1 time: 0.149373 Jun 02 16:14:01.832698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 381/762] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:01 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:02.009373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:02.009903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:02.016611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:02.017065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:02.017833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:02.018307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:02.022996 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:02.151120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:02.158951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:02.160971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:02.162093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-807d4da2-dfae-4d72-acdd-05c2637abe7e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.156632 Jun 02 16:14:02.162646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 382/763] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:14:02 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:14:02.164106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-23842846-050b-4eb2-81f3-139c92e6d911 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:02.164754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-23842846-050b-4eb2-81f3-139c92e6d911 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:02.171278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-23842846-050b-4eb2-81f3-139c92e6d911 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:02.171731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-23842846-050b-4eb2-81f3-139c92e6d911 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:02.172501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-23842846-050b-4eb2-81f3-139c92e6d911 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:02.172938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-23842846-050b-4eb2-81f3-139c92e6d911 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:02.304875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-23842846-050b-4eb2-81f3-139c92e6d911 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:02.312342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-23842846-050b-4eb2-81f3-139c92e6d911 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.152697 Jun 02 16:14:02.316525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 382/764] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:02 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:02.448010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-b03b2753-10ec-474c-b69c-eaca6d23b24a req-b535a980-b7d9-4711-92ea-1f6320027cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942de225-4aff-4a9e-85f0-634ab0ac44e3", "name": "network-vif-plugged", "status": "completed", "tag": "97598fb5-567e-4cea-b72c-57887c16e355"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:02.456193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-b03b2753-10ec-474c-b69c-eaca6d23b24a req-b535a980-b7d9-4711-92ea-1f6320027cc4 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:02.457165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-b03b2753-10ec-474c-b69c-eaca6d23b24a req-b535a980-b7d9-4711-92ea-1f6320027cc4 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:02.468223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-b03b2753-10ec-474c-b69c-eaca6d23b24a req-b535a980-b7d9-4711-92ea-1f6320027cc4 service nova] Creating event network-vif-plugged:97598fb5-567e-4cea-b72c-57887c16e355 for instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 on hv-cinder-79760 Jun 02 16:14:02.473950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-b03b2753-10ec-474c-b69c-eaca6d23b24a req-b535a980-b7d9-4711-92ea-1f6320027cc4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030412 Jun 02 16:14:02.474560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 383/765] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:02.849342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7180d7b7-7b34-4601-8a11-137abb65fa04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:02.849870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7180d7b7-7b34-4601-8a11-137abb65fa04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:02.856322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7180d7b7-7b34-4601-8a11-137abb65fa04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:02.856783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7180d7b7-7b34-4601-8a11-137abb65fa04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:02.857555 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7180d7b7-7b34-4601-8a11-137abb65fa04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:02.858032 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7180d7b7-7b34-4601-8a11-137abb65fa04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:03.059714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7180d7b7-7b34-4601-8a11-137abb65fa04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:03.067995 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7180d7b7-7b34-4601-8a11-137abb65fa04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1672 microversion: 2.1 time: 0.222799 Jun 02 16:14:03.068576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 383/766] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:02 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1672 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:03.181258 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:03.181953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:03.188246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:03.188675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:03.189403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:03.189843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:03.329595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-43c95e4e-8e7d-48c4-a1b9-e5b1f33538c1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:03.330302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-43c95e4e-8e7d-48c4-a1b9-e5b1f33538c1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:03.337005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43c95e4e-8e7d-48c4-a1b9-e5b1f33538c1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:03.338772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43c95e4e-8e7d-48c4-a1b9-e5b1f33538c1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:03.338772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43c95e4e-8e7d-48c4-a1b9-e5b1f33538c1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:03.338772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43c95e4e-8e7d-48c4-a1b9-e5b1f33538c1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:03.431244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:03.439270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:03.440853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:03.443009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bf0c04d1-7e5e-4779-93ce-3215fe61cd8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.266549 Jun 02 16:14:03.443975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 384/767] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:14:03 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:14:03.490698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-43c95e4e-8e7d-48c4-a1b9-e5b1f33538c1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:03.500108 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-43c95e4e-8e7d-48c4-a1b9-e5b1f33538c1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.174213 Jun 02 16:14:03.510384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 384/768] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:03 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:03.617480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-91db8e22-93da-4f3f-a635-80f179d21e25 req-97dc432e-b195-4f23-8e8f-04f217a96d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90430f1e-1a79-4ab9-b7f7-c44ee8c064d5", "name": "network-vif-deleted", "tag": "ef63a7f5-6a5e-4b24-a830-c7caf3ad05ec"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:03.631291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-91db8e22-93da-4f3f-a635-80f179d21e25 req-97dc432e-b195-4f23-8e8f-04f217a96d70 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:03.631291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-91db8e22-93da-4f3f-a635-80f179d21e25 req-97dc432e-b195-4f23-8e8f-04f217a96d70 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:03.643989 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-91db8e22-93da-4f3f-a635-80f179d21e25 req-97dc432e-b195-4f23-8e8f-04f217a96d70 service nova] Creating event network-vif-deleted:ef63a7f5-6a5e-4b24-a830-c7caf3ad05ec for instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 on hv-cinder-79760 Jun 02 16:14:03.652516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-91db8e22-93da-4f3f-a635-80f179d21e25 req-97dc432e-b195-4f23-8e8f-04f217a96d70 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039945 Jun 02 16:14:03.664139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 385/769] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:04.084984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e2d9fc6b-6e63-4f08-b663-6fd14348f347 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:04.085702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e2d9fc6b-6e63-4f08-b663-6fd14348f347 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:04.092581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2d9fc6b-6e63-4f08-b663-6fd14348f347 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:04.093076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2d9fc6b-6e63-4f08-b663-6fd14348f347 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:04.093974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2d9fc6b-6e63-4f08-b663-6fd14348f347 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:04.094717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2d9fc6b-6e63-4f08-b663-6fd14348f347 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:04.162607 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e2d9fc6b-6e63-4f08-b663-6fd14348f347 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:04.170407 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e2d9fc6b-6e63-4f08-b663-6fd14348f347 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1321 microversion: 2.1 time: 0.089343 Jun 02 16:14:04.171069 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 385/770] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:04 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1321 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:04.461981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:04.462798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:04.468975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:04.469675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:04.470461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:04.470915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:04.521752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bf346c07-6b41-444a-9b81-c17ad3a82f41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:04.523991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bf346c07-6b41-444a-9b81-c17ad3a82f41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:04.536082 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf346c07-6b41-444a-9b81-c17ad3a82f41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:04.536589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf346c07-6b41-444a-9b81-c17ad3a82f41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:04.537382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf346c07-6b41-444a-9b81-c17ad3a82f41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:04.537821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf346c07-6b41-444a-9b81-c17ad3a82f41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:04.646972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:04.655944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:04.658202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:04.659505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-36d8d827-0357-485a-b93f-aaa67bdd8d16 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1407 microversion: 2.20 time: 0.202342 Jun 02 16:14:04.666453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 386/771] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:14:04 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:14:04.711558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1671550689", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1652600266", "security_groups": [{"name": "tempest-secgroup-smoke-1209517144"}], "block_device_mapping_v2": [{"uuid": "f156b467-a65a-4d74-8aee-6e9b3de79201", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9fba98bf-3ab9-444a-8646-4bc03d301c56"}]}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:04.727426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bf346c07-6b41-444a-9b81-c17ad3a82f41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:04.735724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bf346c07-6b41-444a-9b81-c17ad3a82f41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.219993 Jun 02 16:14:04.736492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 386/772] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:04 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:04.826192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.network.neutron [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] validate_networks() for [('9fba98bf-3ab9-444a-8646-4bc03d301c56', None, None, None, None, None)] {{(pid=118256) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:14:05.188034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:05.188646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:05.195330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.195778 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.196552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.196983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.228237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.228688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.229137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lazy-loading 'fault' on Instance uuid 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:14:05.270114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:05.277441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9507492e-4bb1-4bc4-a3a9-e2018bb73223 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 200 len: 1326 microversion: 2.1 time: 0.093299 Jun 02 16:14:05.278013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 387/773] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:05 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:05.281253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Flavor limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:14:05.281749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Image limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:14:05.282335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Flavor pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:14:05.282847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Image pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:14:05.283332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:14:05.292893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.293335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.294157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.294597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.311880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Getting quotas for project 460ea33e74e8480c8b70c8123e81e4c4. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:14:05.315825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Getting quotas for user 5d2ef2aa9b8c46cfb198bd18a5944a85 and project 460ea33e74e8480c8b70c8123e81e4c4. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:14:05.372177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Going to run 1 instances... {{(pid=118256) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:14:05.374267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f156b467-a65a-4d74-8aee-6e9b3de79201',volume_size=None,volume_type=None)] {{(pid=118256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:14:05.678653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:05.679572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:05.686531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.687109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.688110 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.688625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.830588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:05.839389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:05.840912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:05.842061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-aecacffd-c7a1-4a56-a1ea-9b0f7052ea88 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1600 microversion: 2.20 time: 0.167712 Jun 02 16:14:05.842646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 388/774] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:14:05 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:14:05.847485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fcd5bd9b-189d-4cfa-b40b-3f982796e14e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:05.848296 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fcd5bd9b-189d-4cfa-b40b-3f982796e14e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:05.854285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fcd5bd9b-189d-4cfa-b40b-3f982796e14e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.861257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fcd5bd9b-189d-4cfa-b40b-3f982796e14e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.861257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fcd5bd9b-189d-4cfa-b40b-3f982796e14e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.861257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fcd5bd9b-189d-4cfa-b40b-3f982796e14e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.865642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e33ed906-3107-4da3-90c7-17ec85e5e5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.159176 Jun 02 16:14:05.866405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 387/775] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:14:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:14:05.876950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5342ddc1-a49a-4ca1-9404-0628f29cacca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:05.877539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5342ddc1-a49a-4ca1-9404-0628f29cacca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:05.887310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5342ddc1-a49a-4ca1-9404-0628f29cacca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.888279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5342ddc1-a49a-4ca1-9404-0628f29cacca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.888696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5342ddc1-a49a-4ca1-9404-0628f29cacca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:05.889235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5342ddc1-a49a-4ca1-9404-0628f29cacca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:05.984843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5342ddc1-a49a-4ca1-9404-0628f29cacca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.111911 Jun 02 16:14:05.985426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 388/776] 10.222.0.59 () {60 vars in 1315 bytes} [Thu Jun 2 16:14:05 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:14:05.997398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6554f16d-1b83-422b-ab04-40c8d048ebaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:05.998716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6554f16d-1b83-422b-ab04-40c8d048ebaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:06.016401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fcd5bd9b-189d-4cfa-b40b-3f982796e14e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:06.025564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fcd5bd9b-189d-4cfa-b40b-3f982796e14e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.181883 Jun 02 16:14:06.027021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 389/777] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:05 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:06.082658 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6554f16d-1b83-422b-ab04-40c8d048ebaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:06.089282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6554f16d-1b83-422b-ab04-40c8d048ebaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1095 microversion: 2.1 time: 0.096122 Jun 02 16:14:06.090775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 389/778] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:06.295954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:06.299537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:06.306865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:06.307313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:06.308740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:06.308740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:06.323728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] HTTP exception thrown: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Request method failure captured: Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 HTTP/1.1 Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOAOBmBuaexkTflPXcayAEThTbf8iE3BWp3JtDWfPGIjHoJ9ACyeyuDs16-SCzAeNmT0gqjDo6UB6yigj8cXMNgNeNMGOHXSve2C1UsOfAJST4nsVa9n-ULUM_EDhNU41RY93sDE6G5YaVjq7a_bYn6xn8uDBzZWw-oNXDltc5ewS_Q Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:14:06.325479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}] Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 88bb3d2dbcdb45bb8baba424e5239e21 Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:14:06.327105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '90430f1e-1a79-4ab9-b7f7-c44ee8c064d5'} Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:14:06.328035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:14:06.329484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:06.332002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Returning 404 to user: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:14:06.332002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6ac1143c-d098-49c7-afd8-0df820b14c23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 404 len: 111 microversion: 2.1 time: 0.034999 Jun 02 16:14:06.332002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 390/779] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:06 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:14:06.338306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a2b7f0e5-c0e1-488e-84d5-ac05545c4090 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '.version_select at 0x7f2d60c56d30>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:06.344537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:06.463324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a2b7f0e5-c0e1-488e-84d5-ac05545c4090 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909666240" status: 202 len: 0 microversion: 2.1 time: 0.128934 Jun 02 16:14:06.464031 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 390/780] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jun 2 16:14:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909666240 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 16:14:07.044515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-305f1d83-5278-47f9-a1c4-dddf1e724a0c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:07.045134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-305f1d83-5278-47f9-a1c4-dddf1e724a0c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:07.052512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-305f1d83-5278-47f9-a1c4-dddf1e724a0c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:07.054365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-305f1d83-5278-47f9-a1c4-dddf1e724a0c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:07.054365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-305f1d83-5278-47f9-a1c4-dddf1e724a0c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:07.054365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-305f1d83-5278-47f9-a1c4-dddf1e724a0c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:07.107687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1091c02c-cae3-4372-8354-e8b876a73c62 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:07.108217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1091c02c-cae3-4372-8354-e8b876a73c62 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:07.200463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-305f1d83-5278-47f9-a1c4-dddf1e724a0c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:07.208646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-305f1d83-5278-47f9-a1c4-dddf1e724a0c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.167974 Jun 02 16:14:07.209324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 391/781] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:07 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:07.268067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1091c02c-cae3-4372-8354-e8b876a73c62 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:07.275075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1091c02c-cae3-4372-8354-e8b876a73c62 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1095 microversion: 2.1 time: 0.171644 Jun 02 16:14:07.275648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 391/782] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:07 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1095 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:07.587186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-1024eb0d-345f-4d85-9905-6b2fd15ba5fc req-89033aff-c6fa-49f1-ab60-21ac7a875232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942de225-4aff-4a9e-85f0-634ab0ac44e3", "tag": "97598fb5-567e-4cea-b72c-57887c16e355"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:07.595981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-1024eb0d-345f-4d85-9905-6b2fd15ba5fc req-89033aff-c6fa-49f1-ab60-21ac7a875232 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:07.596540 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-1024eb0d-345f-4d85-9905-6b2fd15ba5fc req-89033aff-c6fa-49f1-ab60-21ac7a875232 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:07.608890 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-1024eb0d-345f-4d85-9905-6b2fd15ba5fc req-89033aff-c6fa-49f1-ab60-21ac7a875232 service nova] Creating event network-changed:97598fb5-567e-4cea-b72c-57887c16e355 for instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 on hv-cinder-79760 Jun 02 16:14:07.614527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-1024eb0d-345f-4d85-9905-6b2fd15ba5fc req-89033aff-c6fa-49f1-ab60-21ac7a875232 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031532 Jun 02 16:14:07.615406 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 392/783] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:07.902984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d92ea8d5-feb2-4adc-9687-0c3ad4aa22aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'create', calling method: .version_select at 0x7f2d60d7cf70>, body: {"keypair": {"name": "tempest-keypair-81450780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkJ8/hrKHSo7XNGr0gmsaz5yyE/kwfCQpo3+K7Ha6oDk43MJCNS1F3J9OHt+szhpsUZzjRirE0gKzAb1XzXCaawaa4x7J0hJUW7r13TLmXRkeQF1Y3h3GNe3N0ndiQ4ew=="}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:07.934886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-d92ea8d5-feb2-4adc-9687-0c3ad4aa22aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Getting quotas for project 9598d078f4a1477babe0eaf804ef54a8. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:14:07.940502 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-d92ea8d5-feb2-4adc-9687-0c3ad4aa22aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Getting quotas for user 88bb3d2dbcdb45bb8baba424e5239e21 and project 9598d078f4a1477babe0eaf804ef54a8. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:14:08.079865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d92ea8d5-feb2-4adc-9687-0c3ad4aa22aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.180808 Jun 02 16:14:08.086504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 392/784] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 2 16:14:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:08.230623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0ce4d77f-767b-47be-b0e9-d655641695b4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:08.231950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0ce4d77f-767b-47be-b0e9-d655641695b4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:08.240511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0ce4d77f-767b-47be-b0e9-d655641695b4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:08.241172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0ce4d77f-767b-47be-b0e9-d655641695b4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:08.242217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0ce4d77f-767b-47be-b0e9-d655641695b4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:08.242819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0ce4d77f-767b-47be-b0e9-d655641695b4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:08.293147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-40c1bd45-b537-4b31-a6db-8d8fdd8e8d73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:08.294103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-40c1bd45-b537-4b31-a6db-8d8fdd8e8d73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:08.301098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40c1bd45-b537-4b31-a6db-8d8fdd8e8d73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:08.301647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40c1bd45-b537-4b31-a6db-8d8fdd8e8d73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:08.302528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40c1bd45-b537-4b31-a6db-8d8fdd8e8d73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:08.303202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40c1bd45-b537-4b31-a6db-8d8fdd8e8d73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:08.385797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-40c1bd45-b537-4b31-a6db-8d8fdd8e8d73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:08.398493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-40c1bd45-b537-4b31-a6db-8d8fdd8e8d73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1193 microversion: 2.1 time: 0.104978 Jun 02 16:14:08.398493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 393/785] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:08 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:08.420586 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0ce4d77f-767b-47be-b0e9-d655641695b4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:08.429180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0ce4d77f-767b-47be-b0e9-d655641695b4 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.206278 Jun 02 16:14:08.429756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 393/786] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:08 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:09.412827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-926e3465-2d84-484e-9295-236a36f7af37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:09.413434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-926e3465-2d84-484e-9295-236a36f7af37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:09.420035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-926e3465-2d84-484e-9295-236a36f7af37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:09.420480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-926e3465-2d84-484e-9295-236a36f7af37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:09.426490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-926e3465-2d84-484e-9295-236a36f7af37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:09.426490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-926e3465-2d84-484e-9295-236a36f7af37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:09.448160 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-10f47001-5ef6-412a-b1d0-85fc26e32853 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:09.449481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-10f47001-5ef6-412a-b1d0-85fc26e32853 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:09.456505 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10f47001-5ef6-412a-b1d0-85fc26e32853 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:09.459672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10f47001-5ef6-412a-b1d0-85fc26e32853 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:09.459672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10f47001-5ef6-412a-b1d0-85fc26e32853 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:09.459672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10f47001-5ef6-412a-b1d0-85fc26e32853 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:09.497564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-926e3465-2d84-484e-9295-236a36f7af37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:09.506189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-926e3465-2d84-484e-9295-236a36f7af37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1211 microversion: 2.1 time: 0.097952 Jun 02 16:14:09.506779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 394/787] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:09 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:09.612241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-10f47001-5ef6-412a-b1d0-85fc26e32853 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:09.620112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-10f47001-5ef6-412a-b1d0-85fc26e32853 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.176570 Jun 02 16:14:09.620880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 394/788] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:09 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:10.526500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-72d3255e-c0b5-4fde-be7f-8ca9564f2505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:10.528359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-72d3255e-c0b5-4fde-be7f-8ca9564f2505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:10.537597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-72d3255e-c0b5-4fde-be7f-8ca9564f2505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:10.538412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-72d3255e-c0b5-4fde-be7f-8ca9564f2505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:10.539544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-72d3255e-c0b5-4fde-be7f-8ca9564f2505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:10.540198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-72d3255e-c0b5-4fde-be7f-8ca9564f2505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:10.638123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6684d3c4-0cd2-4eeb-8952-53a446ee0635 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:10.639294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6684d3c4-0cd2-4eeb-8952-53a446ee0635 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:10.647123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6684d3c4-0cd2-4eeb-8952-53a446ee0635 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:10.647567 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6684d3c4-0cd2-4eeb-8952-53a446ee0635 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:10.648342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6684d3c4-0cd2-4eeb-8952-53a446ee0635 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:10.648937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6684d3c4-0cd2-4eeb-8952-53a446ee0635 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:10.720852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-72d3255e-c0b5-4fde-be7f-8ca9564f2505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:10.729783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-72d3255e-c0b5-4fde-be7f-8ca9564f2505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1279 microversion: 2.1 time: 0.210080 Jun 02 16:14:10.730394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 395/789] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1279 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:10.794174 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-1d6d8ab8-8e31-4a2d-8230-c9376713487f req-9aa9c44d-f417-4ab8-87fe-0aaa4719048b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63dfa5a1-a050-48bc-a951-56b9093f383e", "tag": "ecf8ce15-849d-46b2-abea-5266d22786b8"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:10.805647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-1d6d8ab8-8e31-4a2d-8230-c9376713487f req-9aa9c44d-f417-4ab8-87fe-0aaa4719048b service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:10.806533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-1d6d8ab8-8e31-4a2d-8230-c9376713487f req-9aa9c44d-f417-4ab8-87fe-0aaa4719048b service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:10.821616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-1d6d8ab8-8e31-4a2d-8230-c9376713487f req-9aa9c44d-f417-4ab8-87fe-0aaa4719048b service nova] Creating event network-changed:ecf8ce15-849d-46b2-abea-5266d22786b8 for instance 63dfa5a1-a050-48bc-a951-56b9093f383e on hv-cinder-79760 Jun 02 16:14:10.827935 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-1d6d8ab8-8e31-4a2d-8230-c9376713487f req-9aa9c44d-f417-4ab8-87fe-0aaa4719048b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038142 Jun 02 16:14:10.837449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 396/790] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:14:11.147551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6684d3c4-0cd2-4eeb-8952-53a446ee0635 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:11.155575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6684d3c4-0cd2-4eeb-8952-53a446ee0635 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.521315 Jun 02 16:14:11.156164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 395/791] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:10 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:11.537788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1641745773", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6e3f563-9a7e-4182-811c-dc16adc4c594"}], "security_groups": [{"name": "tempest-securitygroup--1373363238"}], "key_name": "tempest-keypair-81450780", "user_data": "}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:11.640238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.network.neutron [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] validate_networks() for [('d6e3f563-9a7e-4182-811c-dc16adc4c594', None, None, None, None, None)] {{(pid=118256) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:14:11.748009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c7668ab0-ebd1-4d97-a770-aee7144f5288 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:11.748663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c7668ab0-ebd1-4d97-a770-aee7144f5288 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:11.751352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:11.757580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7668ab0-ebd1-4d97-a770-aee7144f5288 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:11.758031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7668ab0-ebd1-4d97-a770-aee7144f5288 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:11.758836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7668ab0-ebd1-4d97-a770-aee7144f5288 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:11.759280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7668ab0-ebd1-4d97-a770-aee7144f5288 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:11.906300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c7668ab0-ebd1-4d97-a770-aee7144f5288 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:11.914291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c7668ab0-ebd1-4d97-a770-aee7144f5288 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1267 microversion: 2.1 time: 0.170065 Jun 02 16:14:11.914875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 396/792] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:11.919594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e9834cf2-d381-4c8e-a36d-0ea14d3deb08 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:11.920018 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e9834cf2-d381-4c8e-a36d-0ea14d3deb08 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:11.925795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9834cf2-d381-4c8e-a36d-0ea14d3deb08 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:11.926286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9834cf2-d381-4c8e-a36d-0ea14d3deb08 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:11.927058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9834cf2-d381-4c8e-a36d-0ea14d3deb08 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:11.927495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e9834cf2-d381-4c8e-a36d-0ea14d3deb08 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:12.008303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-e9834cf2-d381-4c8e-a36d-0ea14d3deb08 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lazy-loading 'services' on Instance uuid 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:14:12.011724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:12.031329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Flavor limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:14:12.031750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Image limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:14:12.032231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Flavor pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:14:12.032643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Image pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:14:12.033052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:14:12.042014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:12.042497 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:12.043300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:12.043737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:12.060196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Getting quotas for project 9598d078f4a1477babe0eaf804ef54a8. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:14:12.064287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Getting quotas for user 88bb3d2dbcdb45bb8baba424e5239e21 and project 9598d078f4a1477babe0eaf804ef54a8. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:14:12.075752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Going to run 1 instances... {{(pid=118256) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:14:12.078121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:14:12.241973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-561a7df2-b139-4f6f-9e85-974f1d3f9f40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.710044 Jun 02 16:14:12.244166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 397/793] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:14:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:14:12.247388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1bc763e8-9985-4a28-94cd-b4ad856448a3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:12.248231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1bc763e8-9985-4a28-94cd-b4ad856448a3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:12.255785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bc763e8-9985-4a28-94cd-b4ad856448a3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:12.256229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bc763e8-9985-4a28-94cd-b4ad856448a3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:12.256993 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bc763e8-9985-4a28-94cd-b4ad856448a3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:12.257421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bc763e8-9985-4a28-94cd-b4ad856448a3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:12.262831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e9834cf2-d381-4c8e-a36d-0ea14d3deb08 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "DELETE /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments/9f6280a1-4a3d-4aa7-837b-65498e77807e" status: 202 len: 0 microversion: 2.1 time: 0.346372 Jun 02 16:14:12.279760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 397/794] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:14:11 2022] DELETE /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments/9f6280a1-4a3d-4aa7-837b-65498e77807e => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:14:12.285848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1c0e3b97-435c-4e75-b073-2c5c33026fbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:12.286799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1c0e3b97-435c-4e75-b073-2c5c33026fbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:12.354737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1c0e3b97-435c-4e75-b073-2c5c33026fbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:12.363704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1c0e3b97-435c-4e75-b073-2c5c33026fbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1236 microversion: 2.1 time: 0.081599 Jun 02 16:14:12.364667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 398/795] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:12.369609 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1b51d3a3-b984-4d84-b28f-8289cd7b974f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:12.370986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1b51d3a3-b984-4d84-b28f-8289cd7b974f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:12.385271 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b51d3a3-b984-4d84-b28f-8289cd7b974f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:12.386515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b51d3a3-b984-4d84-b28f-8289cd7b974f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:12.387904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b51d3a3-b984-4d84-b28f-8289cd7b974f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:12.388364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b51d3a3-b984-4d84-b28f-8289cd7b974f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:12.457961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1b51d3a3-b984-4d84-b28f-8289cd7b974f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091909 Jun 02 16:14:12.459359 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 399/796] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:14:12 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:12.506761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1bc763e8-9985-4a28-94cd-b4ad856448a3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:12.514712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1bc763e8-9985-4a28-94cd-b4ad856448a3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.271122 Jun 02 16:14:12.515277 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 398/797] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:12 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:12.932285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6422a9c8-1c21-4d66-88e0-3ebe6addc83a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:12.932904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6422a9c8-1c21-4d66-88e0-3ebe6addc83a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:12.943256 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6422a9c8-1c21-4d66-88e0-3ebe6addc83a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:12.943256 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6422a9c8-1c21-4d66-88e0-3ebe6addc83a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:12.943592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6422a9c8-1c21-4d66-88e0-3ebe6addc83a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:12.944033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6422a9c8-1c21-4d66-88e0-3ebe6addc83a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:13.086043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6422a9c8-1c21-4d66-88e0-3ebe6addc83a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:13.093839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6422a9c8-1c21-4d66-88e0-3ebe6addc83a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1267 microversion: 2.1 time: 0.165359 Jun 02 16:14:13.094770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 400/798] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:13.381203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ee166525-338b-41d6-8f57-9d7c8fae4e34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:13.381830 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ee166525-338b-41d6-8f57-9d7c8fae4e34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:13.388302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee166525-338b-41d6-8f57-9d7c8fae4e34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:13.388747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee166525-338b-41d6-8f57-9d7c8fae4e34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:13.389504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee166525-338b-41d6-8f57-9d7c8fae4e34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:13.389935 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee166525-338b-41d6-8f57-9d7c8fae4e34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:13.460147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ee166525-338b-41d6-8f57-9d7c8fae4e34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:13.467706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ee166525-338b-41d6-8f57-9d7c8fae4e34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1240 microversion: 2.1 time: 0.090843 Jun 02 16:14:13.469101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 399/799] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:13 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:13.471961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a4f0363f-c938-4ca3-9af6-5a3ce93f114f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:13.472879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a4f0363f-c938-4ca3-9af6-5a3ce93f114f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:13.479253 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4f0363f-c938-4ca3-9af6-5a3ce93f114f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:13.479691 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4f0363f-c938-4ca3-9af6-5a3ce93f114f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:13.480503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4f0363f-c938-4ca3-9af6-5a3ce93f114f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:13.480967 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4f0363f-c938-4ca3-9af6-5a3ce93f114f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:13.509731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a4f0363f-c938-4ca3-9af6-5a3ce93f114f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042164 Jun 02 16:14:13.510303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 401/800] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:14:13 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:13.531796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e5fe9355-5785-436d-bebe-8845f9faa37d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:13.532534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e5fe9355-5785-436d-bebe-8845f9faa37d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:13.538668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5fe9355-5785-436d-bebe-8845f9faa37d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:13.539119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5fe9355-5785-436d-bebe-8845f9faa37d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:13.539883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5fe9355-5785-436d-bebe-8845f9faa37d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:13.540318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5fe9355-5785-436d-bebe-8845f9faa37d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:13.675581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e5fe9355-5785-436d-bebe-8845f9faa37d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:13.683143 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e5fe9355-5785-436d-bebe-8845f9faa37d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.155220 Jun 02 16:14:13.683708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 400/801] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:13 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:14.111990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d97f07c4-7c00-4ff2-93ed-a7a2076538cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:14.112637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d97f07c4-7c00-4ff2-93ed-a7a2076538cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:14.119114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d97f07c4-7c00-4ff2-93ed-a7a2076538cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.119562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d97f07c4-7c00-4ff2-93ed-a7a2076538cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.120318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d97f07c4-7c00-4ff2-93ed-a7a2076538cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.120761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d97f07c4-7c00-4ff2-93ed-a7a2076538cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.254449 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d97f07c4-7c00-4ff2-93ed-a7a2076538cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:14.264582 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d97f07c4-7c00-4ff2-93ed-a7a2076538cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1267 microversion: 2.1 time: 0.155991 Jun 02 16:14:14.265240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 402/802] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:14.484394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cab89c84-b590-4789-af2c-118cacff7551 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:14.485094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cab89c84-b590-4789-af2c-118cacff7551 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:14.492285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cab89c84-b590-4789-af2c-118cacff7551 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.492726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cab89c84-b590-4789-af2c-118cacff7551 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.493479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cab89c84-b590-4789-af2c-118cacff7551 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.493912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cab89c84-b590-4789-af2c-118cacff7551 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.521409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f8a3961f-550c-4d1c-a10a-bcd70f5f993e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:14.522502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f8a3961f-550c-4d1c-a10a-bcd70f5f993e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:14.528899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8a3961f-550c-4d1c-a10a-bcd70f5f993e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.529359 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8a3961f-550c-4d1c-a10a-bcd70f5f993e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.530502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8a3961f-550c-4d1c-a10a-bcd70f5f993e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.536646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8a3961f-550c-4d1c-a10a-bcd70f5f993e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.555528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cab89c84-b590-4789-af2c-118cacff7551 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:14.561239 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f8a3961f-550c-4d1c-a10a-bcd70f5f993e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044230 Jun 02 16:14:14.561821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 403/803] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:14:14 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 16:14:14.565239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cab89c84-b590-4789-af2c-118cacff7551 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1232 microversion: 2.1 time: 0.082555 Jun 02 16:14:14.565239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 401/804] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1232 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:14.636305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-764a4892-35d7-41ca-b034-38e09e867a7d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:14.636805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-764a4892-35d7-41ca-b034-38e09e867a7d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:14.642877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-764a4892-35d7-41ca-b034-38e09e867a7d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.643334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-764a4892-35d7-41ca-b034-38e09e867a7d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.644334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-764a4892-35d7-41ca-b034-38e09e867a7d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.644783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-764a4892-35d7-41ca-b034-38e09e867a7d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.669031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-764a4892-35d7-41ca-b034-38e09e867a7d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Going to try to terminate instance {{(pid=118257) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:14:14.699852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-07c61990-ef85-45b5-8dcd-7de07651989d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:14.700489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-07c61990-ef85-45b5-8dcd-7de07651989d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:14.706496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-07c61990-ef85-45b5-8dcd-7de07651989d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.707093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-07c61990-ef85-45b5-8dcd-7de07651989d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.707865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-07c61990-ef85-45b5-8dcd-7de07651989d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.708300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-07c61990-ef85-45b5-8dcd-7de07651989d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.844670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-07c61990-ef85-45b5-8dcd-7de07651989d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:14.853042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-07c61990-ef85-45b5-8dcd-7de07651989d tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1570 microversion: 2.1 time: 0.156949 Jun 02 16:14:14.853610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 402/805] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:14 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:14.869704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-43ed0c12-d5d6-444c-96b3-20983d81b2f9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:14.870321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-43ed0c12-d5d6-444c-96b3-20983d81b2f9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:14.877039 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43ed0c12-d5d6-444c-96b3-20983d81b2f9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.877528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43ed0c12-d5d6-444c-96b3-20983d81b2f9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.878317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43ed0c12-d5d6-444c-96b3-20983d81b2f9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.878783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43ed0c12-d5d6-444c-96b3-20983d81b2f9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.975589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-764a4892-35d7-41ca-b034-38e09e867a7d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "DELETE /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 204 len: 0 microversion: 2.1 time: 0.342788 Jun 02 16:14:14.976186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 404/806] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:14:14 2022] DELETE /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:14:14.984428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-30cfe2c4-49f2-41a9-bd11-56ea7c42bcf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:14.985164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-30cfe2c4-49f2-41a9-bd11-56ea7c42bcf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:14.992663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30cfe2c4-49f2-41a9-bd11-56ea7c42bcf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.993116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30cfe2c4-49f2-41a9-bd11-56ea7c42bcf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:14.993890 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30cfe2c4-49f2-41a9-bd11-56ea7c42bcf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:14.994372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30cfe2c4-49f2-41a9-bd11-56ea7c42bcf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:15.125523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-43ed0c12-d5d6-444c-96b3-20983d81b2f9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "POST /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b/action" status: 202 len: 0 microversion: 2.1 time: 0.259306 Jun 02 16:14:15.126232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 403/807] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:14:14 2022] POST /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 16:14:15.127237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-30cfe2c4-49f2-41a9-bd11-56ea7c42bcf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:15.134466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-280ea76d-b145-49e1-8cc5-ef75fc095682 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:15.135365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-280ea76d-b145-49e1-8cc5-ef75fc095682 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:15.136304 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-30cfe2c4-49f2-41a9-bd11-56ea7c42bcf4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1690 microversion: 2.1 time: 0.155797 Jun 02 16:14:15.136845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 405/808] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:14 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:15.143531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-280ea76d-b145-49e1-8cc5-ef75fc095682 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:15.145560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-280ea76d-b145-49e1-8cc5-ef75fc095682 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:15.150669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-280ea76d-b145-49e1-8cc5-ef75fc095682 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:15.150669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-280ea76d-b145-49e1-8cc5-ef75fc095682 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:15.282988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bff1f702-8c20-4b86-bcca-2ef06be34216 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:15.283426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-280ea76d-b145-49e1-8cc5-ef75fc095682 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:15.283579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bff1f702-8c20-4b86-bcca-2ef06be34216 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:15.290677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff1f702-8c20-4b86-bcca-2ef06be34216 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:15.291120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff1f702-8c20-4b86-bcca-2ef06be34216 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:15.292061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff1f702-8c20-4b86-bcca-2ef06be34216 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:15.292648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-280ea76d-b145-49e1-8cc5-ef75fc095682 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1578 microversion: 2.1 time: 0.162389 Jun 02 16:14:15.292832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff1f702-8c20-4b86-bcca-2ef06be34216 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:15.293225 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 404/809] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:15 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:15.443766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bff1f702-8c20-4b86-bcca-2ef06be34216 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:15.452136 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bff1f702-8c20-4b86-bcca-2ef06be34216 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1267 microversion: 2.1 time: 0.172920 Jun 02 16:14:15.452719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 406/810] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:15.582004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a152f527-7411-4cef-a2af-2d2da5d36f34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:15.582685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a152f527-7411-4cef-a2af-2d2da5d36f34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:15.589341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a152f527-7411-4cef-a2af-2d2da5d36f34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:15.589795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a152f527-7411-4cef-a2af-2d2da5d36f34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:15.590736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a152f527-7411-4cef-a2af-2d2da5d36f34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:15.591178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a152f527-7411-4cef-a2af-2d2da5d36f34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:15.609485 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:15.653608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a152f527-7411-4cef-a2af-2d2da5d36f34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:15.661033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a152f527-7411-4cef-a2af-2d2da5d36f34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1288 microversion: 2.1 time: 0.083699 Jun 02 16:14:15.663834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 405/811] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:15 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:16.153968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c74185aa-b20a-41ce-a8e3-67e2b6185978 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:16.154624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c74185aa-b20a-41ce-a8e3-67e2b6185978 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:16.161208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c74185aa-b20a-41ce-a8e3-67e2b6185978 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:16.161707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c74185aa-b20a-41ce-a8e3-67e2b6185978 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:16.162520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c74185aa-b20a-41ce-a8e3-67e2b6185978 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:16.162955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c74185aa-b20a-41ce-a8e3-67e2b6185978 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:16.293256 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c74185aa-b20a-41ce-a8e3-67e2b6185978 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:16.298333 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c74185aa-b20a-41ce-a8e3-67e2b6185978 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1690 microversion: 2.1 time: 0.148225 Jun 02 16:14:16.299095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 407/812] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:16 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:16.309613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c9634bfd-6852-41e7-a4a9-c0740fa03167 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:16.310270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c9634bfd-6852-41e7-a4a9-c0740fa03167 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:16.317401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9634bfd-6852-41e7-a4a9-c0740fa03167 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:16.317849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9634bfd-6852-41e7-a4a9-c0740fa03167 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:16.318657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9634bfd-6852-41e7-a4a9-c0740fa03167 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:16.319093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c9634bfd-6852-41e7-a4a9-c0740fa03167 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:16.452945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c9634bfd-6852-41e7-a4a9-c0740fa03167 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:16.461331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c9634bfd-6852-41e7-a4a9-c0740fa03167 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1578 microversion: 2.1 time: 0.155558 Jun 02 16:14:16.462121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 406/813] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:16 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:16.476589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f2349a41-562e-4384-b603-bbf32bf25f0e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:16.477221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f2349a41-562e-4384-b603-bbf32bf25f0e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:16.483114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2349a41-562e-4384-b603-bbf32bf25f0e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:16.483560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2349a41-562e-4384-b603-bbf32bf25f0e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:16.484323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2349a41-562e-4384-b603-bbf32bf25f0e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:16.484757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2349a41-562e-4384-b603-bbf32bf25f0e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:16.515390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-a38227c6-306e-4949-b9fe-edd376f8c806 req-7647da88-8728-4fc8-a8ce-4078d5493f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07acc928-a366-4e20-8462-b4e78a2a4e0b", "name": "network-vif-unplugged", "status": "completed", "tag": "3b9de9f4-4fd1-4131-9b1c-81b197b00a5f"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:16.524550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-a38227c6-306e-4949-b9fe-edd376f8c806 req-7647da88-8728-4fc8-a8ce-4078d5493f85 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:16.525093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-a38227c6-306e-4949-b9fe-edd376f8c806 req-7647da88-8728-4fc8-a8ce-4078d5493f85 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:16.537307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-a38227c6-306e-4949-b9fe-edd376f8c806 req-7647da88-8728-4fc8-a8ce-4078d5493f85 service nova] Creating event network-vif-unplugged:3b9de9f4-4fd1-4131-9b1c-81b197b00a5f for instance 07acc928-a366-4e20-8462-b4e78a2a4e0b on hv-cinder-79760 Jun 02 16:14:16.542465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-a38227c6-306e-4949-b9fe-edd376f8c806 req-7647da88-8728-4fc8-a8ce-4078d5493f85 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030628 Jun 02 16:14:16.543480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 407/814] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:16.623799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f2349a41-562e-4384-b603-bbf32bf25f0e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:16.632335 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f2349a41-562e-4384-b603-bbf32bf25f0e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1267 microversion: 2.1 time: 0.159530 Jun 02 16:14:16.632905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 408/815] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:16 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:16.680387 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-55d8f0f0-6c81-4e67-bfef-beec1dc17db9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:16.681112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-55d8f0f0-6c81-4e67-bfef-beec1dc17db9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:16.687393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55d8f0f0-6c81-4e67-bfef-beec1dc17db9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:16.687850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55d8f0f0-6c81-4e67-bfef-beec1dc17db9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:16.688668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55d8f0f0-6c81-4e67-bfef-beec1dc17db9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:16.689099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55d8f0f0-6c81-4e67-bfef-beec1dc17db9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:16.752845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-55d8f0f0-6c81-4e67-bfef-beec1dc17db9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:16.760770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-55d8f0f0-6c81-4e67-bfef-beec1dc17db9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1288 microversion: 2.1 time: 0.086273 Jun 02 16:14:16.761330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 408/816] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:17.315832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cefac940-ae13-4868-a2d2-a88c8160bce8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:17.316691 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cefac940-ae13-4868-a2d2-a88c8160bce8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:17.323389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cefac940-ae13-4868-a2d2-a88c8160bce8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:17.323846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cefac940-ae13-4868-a2d2-a88c8160bce8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:17.324620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cefac940-ae13-4868-a2d2-a88c8160bce8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:17.325061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cefac940-ae13-4868-a2d2-a88c8160bce8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:17.453915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cefac940-ae13-4868-a2d2-a88c8160bce8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:17.462416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cefac940-ae13-4868-a2d2-a88c8160bce8 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1690 microversion: 2.1 time: 0.150446 Jun 02 16:14:17.463008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 409/817] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:17 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:17.480121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7a019ce7-0e03-4af0-9bf6-6212614c4a0b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:17.480736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7a019ce7-0e03-4af0-9bf6-6212614c4a0b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:17.486706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a019ce7-0e03-4af0-9bf6-6212614c4a0b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:17.487182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a019ce7-0e03-4af0-9bf6-6212614c4a0b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:17.488131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a019ce7-0e03-4af0-9bf6-6212614c4a0b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:17.488596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a019ce7-0e03-4af0-9bf6-6212614c4a0b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:17.616071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7a019ce7-0e03-4af0-9bf6-6212614c4a0b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:17.623547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7a019ce7-0e03-4af0-9bf6-6212614c4a0b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1578 microversion: 2.1 time: 0.147240 Jun 02 16:14:17.624116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 409/818] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:17 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:17.649164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7fcebf80-875b-4a5d-a243-e88352fa4652 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:17.649777 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7fcebf80-875b-4a5d-a243-e88352fa4652 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:17.655930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7fcebf80-875b-4a5d-a243-e88352fa4652 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:17.656332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7fcebf80-875b-4a5d-a243-e88352fa4652 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:17.657098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7fcebf80-875b-4a5d-a243-e88352fa4652 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:17.657539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7fcebf80-875b-4a5d-a243-e88352fa4652 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:17.776802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dada051a-c237-492b-b010-3b11076502a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:17.777522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dada051a-c237-492b-b010-3b11076502a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:17.784050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dada051a-c237-492b-b010-3b11076502a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:17.784931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dada051a-c237-492b-b010-3b11076502a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:17.785811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dada051a-c237-492b-b010-3b11076502a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:17.786283 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dada051a-c237-492b-b010-3b11076502a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:17.791033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7fcebf80-875b-4a5d-a243-e88352fa4652 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:17.798503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7fcebf80-875b-4a5d-a243-e88352fa4652 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1267 microversion: 2.1 time: 0.153136 Jun 02 16:14:17.801664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 410/819] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:17 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:17.854225 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-dada051a-c237-492b-b010-3b11076502a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:17.861496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dada051a-c237-492b-b010-3b11076502a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1288 microversion: 2.1 time: 0.088649 Jun 02 16:14:17.862094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 410/820] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:18.481153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-534b4a20-43d2-4fc1-b5cd-b83f5863a4fd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:18.481901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-534b4a20-43d2-4fc1-b5cd-b83f5863a4fd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:18.489442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-534b4a20-43d2-4fc1-b5cd-b83f5863a4fd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:18.489913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-534b4a20-43d2-4fc1-b5cd-b83f5863a4fd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:18.490726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-534b4a20-43d2-4fc1-b5cd-b83f5863a4fd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:18.491146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-534b4a20-43d2-4fc1-b5cd-b83f5863a4fd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:18.629033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-534b4a20-43d2-4fc1-b5cd-b83f5863a4fd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:18.636889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-534b4a20-43d2-4fc1-b5cd-b83f5863a4fd tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1690 microversion: 2.1 time: 0.159704 Jun 02 16:14:18.637469 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 411/821] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:18 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:18.641882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-4e002517-0e62-45af-8c92-646440f224d5 req-71d3c093-5058-4255-8a4e-76d9a8ed37b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63dfa5a1-a050-48bc-a951-56b9093f383e", "name": "network-vif-plugged", "status": "completed", "tag": "ecf8ce15-849d-46b2-abea-5266d22786b8"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:18.642512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9c1d39f4-ac4c-4a75-8b5f-02e1254cfc41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:18.643191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9c1d39f4-ac4c-4a75-8b5f-02e1254cfc41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:18.649813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c1d39f4-ac4c-4a75-8b5f-02e1254cfc41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:18.650487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c1d39f4-ac4c-4a75-8b5f-02e1254cfc41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:18.650712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-4e002517-0e62-45af-8c92-646440f224d5 req-71d3c093-5058-4255-8a4e-76d9a8ed37b9 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:18.651426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-4e002517-0e62-45af-8c92-646440f224d5 req-71d3c093-5058-4255-8a4e-76d9a8ed37b9 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:18.651544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c1d39f4-ac4c-4a75-8b5f-02e1254cfc41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:18.651838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c1d39f4-ac4c-4a75-8b5f-02e1254cfc41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:18.663495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-4e002517-0e62-45af-8c92-646440f224d5 req-71d3c093-5058-4255-8a4e-76d9a8ed37b9 service nova] Creating event network-vif-plugged:ecf8ce15-849d-46b2-abea-5266d22786b8 for instance 63dfa5a1-a050-48bc-a951-56b9093f383e on hv-cinder-79760 Jun 02 16:14:18.671857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-4e002517-0e62-45af-8c92-646440f224d5 req-71d3c093-5058-4255-8a4e-76d9a8ed37b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029746 Jun 02 16:14:18.671857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 412/822] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:18.785128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9c1d39f4-ac4c-4a75-8b5f-02e1254cfc41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:18.793776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9c1d39f4-ac4c-4a75-8b5f-02e1254cfc41 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1578 microversion: 2.1 time: 0.157247 Jun 02 16:14:18.800624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 411/823] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:18 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:18.815773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b21abfea-944d-4a0d-a6d8-d5d053a1e5c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:18.816502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b21abfea-944d-4a0d-a6d8-d5d053a1e5c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:18.822821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b21abfea-944d-4a0d-a6d8-d5d053a1e5c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:18.827865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b21abfea-944d-4a0d-a6d8-d5d053a1e5c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:18.827865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b21abfea-944d-4a0d-a6d8-d5d053a1e5c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:18.827865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b21abfea-944d-4a0d-a6d8-d5d053a1e5c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:18.878145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3ffd12f8-75fc-4a64-9356-dbfe1ab89696 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:18.878850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3ffd12f8-75fc-4a64-9356-dbfe1ab89696 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:18.884898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ffd12f8-75fc-4a64-9356-dbfe1ab89696 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:18.885416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ffd12f8-75fc-4a64-9356-dbfe1ab89696 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:18.886879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ffd12f8-75fc-4a64-9356-dbfe1ab89696 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:18.886879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ffd12f8-75fc-4a64-9356-dbfe1ab89696 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:18.952296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3ffd12f8-75fc-4a64-9356-dbfe1ab89696 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:18.960011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b21abfea-944d-4a0d-a6d8-d5d053a1e5c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:18.960938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3ffd12f8-75fc-4a64-9356-dbfe1ab89696 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1288 microversion: 2.1 time: 0.086775 Jun 02 16:14:18.961699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 412/824] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:18.967759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b21abfea-944d-4a0d-a6d8-d5d053a1e5c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1267 microversion: 2.1 time: 0.156149 Jun 02 16:14:18.968497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 413/825] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:18 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:19.654245 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-29e850ee-c7db-4a69-aac4-2431673aa975 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:19.654770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-29e850ee-c7db-4a69-aac4-2431673aa975 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:19.661155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29e850ee-c7db-4a69-aac4-2431673aa975 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:19.662191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29e850ee-c7db-4a69-aac4-2431673aa975 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:19.662397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29e850ee-c7db-4a69-aac4-2431673aa975 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:19.662827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29e850ee-c7db-4a69-aac4-2431673aa975 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:19.801559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-29e850ee-c7db-4a69-aac4-2431673aa975 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:19.809602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-29e850ee-c7db-4a69-aac4-2431673aa975 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1690 microversion: 2.1 time: 0.159304 Jun 02 16:14:19.810186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 413/826] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:19 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:19.812274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f0812231-b0e5-47ee-9c36-a6ecf8bd5900 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:19.812895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f0812231-b0e5-47ee-9c36-a6ecf8bd5900 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:19.820366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0812231-b0e5-47ee-9c36-a6ecf8bd5900 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:19.820819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0812231-b0e5-47ee-9c36-a6ecf8bd5900 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:19.821593 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0812231-b0e5-47ee-9c36-a6ecf8bd5900 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:19.822032 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0812231-b0e5-47ee-9c36-a6ecf8bd5900 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:19.826205 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:19.966174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f0812231-b0e5-47ee-9c36-a6ecf8bd5900 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:19.975800 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f0812231-b0e5-47ee-9c36-a6ecf8bd5900 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1518 microversion: 2.1 time: 0.167345 Jun 02 16:14:19.976816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 414/827] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:19 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:19.986527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a1805c1a-3393-431e-9399-d1c877cd9b05 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:19.987251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e413d627-2bde-438c-9e60-c57d3f2df9b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:19.987447 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a1805c1a-3393-431e-9399-d1c877cd9b05 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:19.991346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e413d627-2bde-438c-9e60-c57d3f2df9b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:19.996527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a1805c1a-3393-431e-9399-d1c877cd9b05 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:19.996527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a1805c1a-3393-431e-9399-d1c877cd9b05 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:19.996527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a1805c1a-3393-431e-9399-d1c877cd9b05 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:19.996527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a1805c1a-3393-431e-9399-d1c877cd9b05 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:19.997957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e413d627-2bde-438c-9e60-c57d3f2df9b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:19.998459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e413d627-2bde-438c-9e60-c57d3f2df9b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:19.999475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e413d627-2bde-438c-9e60-c57d3f2df9b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:20.000090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e413d627-2bde-438c-9e60-c57d3f2df9b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:20.106449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e413d627-2bde-438c-9e60-c57d3f2df9b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:20.118141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e413d627-2bde-438c-9e60-c57d3f2df9b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1296 microversion: 2.1 time: 0.143213 Jun 02 16:14:20.119153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 414/828] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:19 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1296 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:20.306883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a1805c1a-3393-431e-9399-d1c877cd9b05 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:20.314826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a1805c1a-3393-431e-9399-d1c877cd9b05 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1267 microversion: 2.1 time: 0.332635 Jun 02 16:14:20.315802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 415/829] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:20.828148 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5c7ba251-81cd-4917-8fd4-ae437959725d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:20.829418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5c7ba251-81cd-4917-8fd4-ae437959725d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:20.840090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5c7ba251-81cd-4917-8fd4-ae437959725d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:20.840670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5c7ba251-81cd-4917-8fd4-ae437959725d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:20.841638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5c7ba251-81cd-4917-8fd4-ae437959725d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:20.842342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5c7ba251-81cd-4917-8fd4-ae437959725d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:20.917228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5c7ba251-81cd-4917-8fd4-ae437959725d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:20.927423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5c7ba251-81cd-4917-8fd4-ae437959725d tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1622 microversion: 2.1 time: 0.103543 Jun 02 16:14:20.928008 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 415/830] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:20 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1622 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:20.992912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b372f174-e318-4d11-b297-f6ca2ec4ac3b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:20.993542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b372f174-e318-4d11-b297-f6ca2ec4ac3b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:21.001728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b372f174-e318-4d11-b297-f6ca2ec4ac3b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.002084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b372f174-e318-4d11-b297-f6ca2ec4ac3b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.003432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b372f174-e318-4d11-b297-f6ca2ec4ac3b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.004066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b372f174-e318-4d11-b297-f6ca2ec4ac3b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.085946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-e79f900b-1de1-4b15-8179-6061b4408fb4 req-9b49438c-7138-4947-acd6-17175c6fc0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef", "name": "network-vif-deleted", "tag": "3c38464f-673f-4bd1-9857-db6554c37dd9"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:21.095311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-e79f900b-1de1-4b15-8179-6061b4408fb4 req-9b49438c-7138-4947-acd6-17175c6fc0de service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.095968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-e79f900b-1de1-4b15-8179-6061b4408fb4 req-9b49438c-7138-4947-acd6-17175c6fc0de service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.115337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-e79f900b-1de1-4b15-8179-6061b4408fb4 req-9b49438c-7138-4947-acd6-17175c6fc0de service nova] Creating event network-vif-deleted:3c38464f-673f-4bd1-9857-db6554c37dd9 for instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef on hv-cinder-79760 Jun 02 16:14:21.120678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-e79f900b-1de1-4b15-8179-6061b4408fb4 req-9b49438c-7138-4947-acd6-17175c6fc0de service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131242 Jun 02 16:14:21.121963 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 416/831] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:14:21.137265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2857cfdf-11ce-47cd-b198-51a383614d44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:21.138051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2857cfdf-11ce-47cd-b198-51a383614d44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:21.145005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2857cfdf-11ce-47cd-b198-51a383614d44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.145806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2857cfdf-11ce-47cd-b198-51a383614d44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.146947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2857cfdf-11ce-47cd-b198-51a383614d44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.147604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2857cfdf-11ce-47cd-b198-51a383614d44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.235981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2857cfdf-11ce-47cd-b198-51a383614d44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:21.248659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2857cfdf-11ce-47cd-b198-51a383614d44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1294 microversion: 2.1 time: 0.115969 Jun 02 16:14:21.249781 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 417/832] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:21.289266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b372f174-e318-4d11-b297-f6ca2ec4ac3b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:21.299207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b372f174-e318-4d11-b297-f6ca2ec4ac3b tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1520 microversion: 2.1 time: 0.309987 Jun 02 16:14:21.299881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 416/833] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:20 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:21.334266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ac92bb7b-0ab9-4e85-ac8d-bc2bdaa65235 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:21.334878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ac92bb7b-0ab9-4e85-ac8d-bc2bdaa65235 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:21.341301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac92bb7b-0ab9-4e85-ac8d-bc2bdaa65235 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.341754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac92bb7b-0ab9-4e85-ac8d-bc2bdaa65235 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.342952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac92bb7b-0ab9-4e85-ac8d-bc2bdaa65235 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.343393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac92bb7b-0ab9-4e85-ac8d-bc2bdaa65235 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.504156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ac92bb7b-0ab9-4e85-ac8d-bc2bdaa65235 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:21.512284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ac92bb7b-0ab9-4e85-ac8d-bc2bdaa65235 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1267 microversion: 2.1 time: 0.182960 Jun 02 16:14:21.512983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 418/834] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:21.945489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:21.946137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:21.952998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.954602 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.955403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.956681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.991767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:21.992286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:21.992740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lazy-loading 'fault' on Instance uuid 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:14:22.037685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:22.045152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e577c1aa-e39f-45e7-900e-74be77c9a8f5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1335 microversion: 2.1 time: 0.104129 Jun 02 16:14:22.050242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 417/835] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:21 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:22.269365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b27fdb0a-51c1-4449-b837-b5177d25b718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:22.269924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b27fdb0a-51c1-4449-b837-b5177d25b718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:22.272430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=4 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:22.273168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=20 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:22.278189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b27fdb0a-51c1-4449-b837-b5177d25b718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:22.278639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b27fdb0a-51c1-4449-b837-b5177d25b718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:22.279401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b27fdb0a-51c1-4449-b837-b5177d25b718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:22.279835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b27fdb0a-51c1-4449-b837-b5177d25b718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:22.318373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7f880ae7-979c-4c4d-8764-f84b9f93aece tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:22.319024 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7f880ae7-979c-4c4d-8764-f84b9f93aece tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:22.328080 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f880ae7-979c-4c4d-8764-f84b9f93aece tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:22.328828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f880ae7-979c-4c4d-8764-f84b9f93aece tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:22.329619 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f880ae7-979c-4c4d-8764-f84b9f93aece tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:22.330057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f880ae7-979c-4c4d-8764-f84b9f93aece tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:22.364025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:22.437697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b27fdb0a-51c1-4449-b837-b5177d25b718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:22.446402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b27fdb0a-51c1-4449-b837-b5177d25b718 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.181546 Jun 02 16:14:22.447050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 419/836] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:22.544811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4a4d7727-3cc3-4df6-b996-321536cf81d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:22.545402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4a4d7727-3cc3-4df6-b996-321536cf81d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:22.553462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a4d7727-3cc3-4df6-b996-321536cf81d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:22.554005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a4d7727-3cc3-4df6-b996-321536cf81d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:22.554687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a4d7727-3cc3-4df6-b996-321536cf81d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:22.555120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a4d7727-3cc3-4df6-b996-321536cf81d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:22.557125 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7f880ae7-979c-4c4d-8764-f84b9f93aece tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:22.564804 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7f880ae7-979c-4c4d-8764-f84b9f93aece tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1520 microversion: 2.1 time: 0.251931 Jun 02 16:14:22.574837 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 418/837] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:22 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:22.695439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4a4d7727-3cc3-4df6-b996-321536cf81d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:22.703218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4a4d7727-3cc3-4df6-b996-321536cf81d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1455 microversion: 2.1 time: 0.162160 Jun 02 16:14:22.703791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 420/838] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:22.726754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9b4b2a66-9e02-4ab6-977b-5e8d862dc24c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:22.727828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9b4b2a66-9e02-4ab6-977b-5e8d862dc24c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:22.735115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b4b2a66-9e02-4ab6-977b-5e8d862dc24c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:22.736006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b4b2a66-9e02-4ab6-977b-5e8d862dc24c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:22.736792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b4b2a66-9e02-4ab6-977b-5e8d862dc24c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:22.737730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b4b2a66-9e02-4ab6-977b-5e8d862dc24c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:22.948400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9b4b2a66-9e02-4ab6-977b-5e8d862dc24c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:22.956309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9b4b2a66-9e02-4ab6-977b-5e8d862dc24c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1455 microversion: 2.1 time: 0.233363 Jun 02 16:14:22.957322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 419/839] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1455 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:23.072593 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:23.073301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:23.079331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:23.079840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:23.080581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:23.081149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:23.118016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:23.118577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:23.119099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lazy-loading 'fault' on Instance uuid 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:14:23.192967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:23.201734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d430a844-6cc2-431c-a256-4fbf6ac269f4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 200 len: 1335 microversion: 2.1 time: 0.132943 Jun 02 16:14:23.202708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 421/840] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:23 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:23.433326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-518adc60-f8cf-40b8-a0ef-791bd936dd06 req-7dd74067-ad85-456d-b7e1-3b1664b9a0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d978fa-9abe-42e1-af29-1ccea22ff4c9", "tag": "3ce4a557-9dd7-4f99-8a53-2bb41b1937c7"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:23.446537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-518adc60-f8cf-40b8-a0ef-791bd936dd06 req-7dd74067-ad85-456d-b7e1-3b1664b9a0f2 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:23.449119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-518adc60-f8cf-40b8-a0ef-791bd936dd06 req-7dd74067-ad85-456d-b7e1-3b1664b9a0f2 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:23.468923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5501decd-c946-4cd1-9ce4-0b8dcaa29bd2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:23.470440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5501decd-c946-4cd1-9ce4-0b8dcaa29bd2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:23.478751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-518adc60-f8cf-40b8-a0ef-791bd936dd06 req-7dd74067-ad85-456d-b7e1-3b1664b9a0f2 service nova] Creating event network-changed:3ce4a557-9dd7-4f99-8a53-2bb41b1937c7 for instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 on hv-cinder-79760 Jun 02 16:14:23.479951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5501decd-c946-4cd1-9ce4-0b8dcaa29bd2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:23.480395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5501decd-c946-4cd1-9ce4-0b8dcaa29bd2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:23.481226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5501decd-c946-4cd1-9ce4-0b8dcaa29bd2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:23.481749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5501decd-c946-4cd1-9ce4-0b8dcaa29bd2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:23.484539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-518adc60-f8cf-40b8-a0ef-791bd936dd06 req-7dd74067-ad85-456d-b7e1-3b1664b9a0f2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054744 Jun 02 16:14:23.485376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 420/841] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:23.586903 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e86b47f8-ea46-45c4-8ca8-9feb08d1da00 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:23.587922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e86b47f8-ea46-45c4-8ca8-9feb08d1da00 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:23.595116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e86b47f8-ea46-45c4-8ca8-9feb08d1da00 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:23.595888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e86b47f8-ea46-45c4-8ca8-9feb08d1da00 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:23.597375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e86b47f8-ea46-45c4-8ca8-9feb08d1da00 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:23.597915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e86b47f8-ea46-45c4-8ca8-9feb08d1da00 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:23.851235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e86b47f8-ea46-45c4-8ca8-9feb08d1da00 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:23.859707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e86b47f8-ea46-45c4-8ca8-9feb08d1da00 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.279800 Jun 02 16:14:23.860601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 421/842] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:23 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:23.951529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5501decd-c946-4cd1-9ce4-0b8dcaa29bd2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:23.960781 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5501decd-c946-4cd1-9ce4-0b8dcaa29bd2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.500017 Jun 02 16:14:23.961363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 422/843] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:24.218731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:24.219867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:24.227246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:24.227975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:24.229010 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:24.229631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:24.248176 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] HTTP exception thrown: Instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef could not be found. Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Request method failure captured: Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef HTTP/1.1 Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOAO7LmHqb4S_f4qwkNYdaHIV121i5tIUgTvVzS00aYcMN7m5pOkeLk6zCuP0R6IV1y0MhhoRJeqYPLyhsXvbyg4WsnBPK6GU_Ip3YjrFLh8AS5JLVg_uIYrdxD1j654pRlGuETGhlXxCeeVYcAJWrmuY6ublaGdQg5AuSzUoIcy7hc Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:14:24.250150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_629a7b91ffc64154a55a45415f739949"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/629a7b91ffc64154a55a45415f739949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}] Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: a8658730ea2a4a06b7b4070976c6397f Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef could not be found. Jun 02 16:14:24.252093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef'} Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef could not be found. Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:14:24.253012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef could not be found. Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef could not be found. Jun 02 16:14:24.254955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:24.256738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Returning 404 to user: Instance 87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:14:24.257768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c4327ff5-2b49-45d8-88dd-f16bfd4e5416 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef" status: 404 len: 111 microversion: 2.1 time: 0.042932 Jun 02 16:14:24.258440 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 422/844] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:24 2022] GET /compute/v2.1/servers/87684bbb-b4f4-4ee7-8b7e-fcc53ddcd8ef => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:14:24.266746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fced7fbc-e70b-4faf-90e8-7d02fac5ea7b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '.version_select at 0x7f2d60d97790>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:24.272836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:24.394487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fced7fbc-e70b-4faf-90e8-7d02fac5ea7b tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-506868210" status: 202 len: 0 microversion: 2.1 time: 0.131233 Jun 02 16:14:24.394974 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 423/845] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jun 2 16:14:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-506868210 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:14:24.877124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4486e6a5-b6a9-474c-a865-195e4a40fed1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:24.878531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4486e6a5-b6a9-474c-a865-195e4a40fed1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:24.885198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4486e6a5-b6a9-474c-a865-195e4a40fed1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:24.885732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4486e6a5-b6a9-474c-a865-195e4a40fed1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:24.886715 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4486e6a5-b6a9-474c-a865-195e4a40fed1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:24.887332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4486e6a5-b6a9-474c-a865-195e4a40fed1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:24.979199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-409bab40-638f-4ef9-8775-15fac59d3bd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:24.979978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-409bab40-638f-4ef9-8775-15fac59d3bd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:24.986848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-409bab40-638f-4ef9-8775-15fac59d3bd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:24.987447 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-409bab40-638f-4ef9-8775-15fac59d3bd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:24.988426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-409bab40-638f-4ef9-8775-15fac59d3bd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:24.989063 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-409bab40-638f-4ef9-8775-15fac59d3bd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:25.008171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:25.091088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4486e6a5-b6a9-474c-a865-195e4a40fed1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:25.101695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4486e6a5-b6a9-474c-a865-195e4a40fed1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.228741 Jun 02 16:14:25.102401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 423/846] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:24 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:25.199418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-409bab40-638f-4ef9-8775-15fac59d3bd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:25.207268 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-409bab40-638f-4ef9-8775-15fac59d3bd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.232746 Jun 02 16:14:25.207843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 424/847] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:25.892370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-b8967b75-276b-4fa8-ba11-6af96a31582d req-bda0ee5c-2165-461e-99c5-1264ec55eecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63dfa5a1-a050-48bc-a951-56b9093f383e", "tag": "ecf8ce15-849d-46b2-abea-5266d22786b8"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:25.902251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-b8967b75-276b-4fa8-ba11-6af96a31582d req-bda0ee5c-2165-461e-99c5-1264ec55eecc service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:25.902719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-b8967b75-276b-4fa8-ba11-6af96a31582d req-bda0ee5c-2165-461e-99c5-1264ec55eecc service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:25.914324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-b8967b75-276b-4fa8-ba11-6af96a31582d req-bda0ee5c-2165-461e-99c5-1264ec55eecc service nova] Creating event network-changed:ecf8ce15-849d-46b2-abea-5266d22786b8 for instance 63dfa5a1-a050-48bc-a951-56b9093f383e on hv-cinder-79760 Jun 02 16:14:25.919283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-b8967b75-276b-4fa8-ba11-6af96a31582d req-bda0ee5c-2165-461e-99c5-1264ec55eecc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030582 Jun 02 16:14:25.920097 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 424/848] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:26.120179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c54499ea-054f-44f4-9e6a-55afbee8d05a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:26.120785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c54499ea-054f-44f4-9e6a-55afbee8d05a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:26.130426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c54499ea-054f-44f4-9e6a-55afbee8d05a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:26.130879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c54499ea-054f-44f4-9e6a-55afbee8d05a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:26.132066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c54499ea-054f-44f4-9e6a-55afbee8d05a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:26.132560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c54499ea-054f-44f4-9e6a-55afbee8d05a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:26.225591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0e7583d0-9d5c-498a-a408-1a0d5a5c3554 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:26.226332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0e7583d0-9d5c-498a-a408-1a0d5a5c3554 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:26.232913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e7583d0-9d5c-498a-a408-1a0d5a5c3554 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:26.233644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e7583d0-9d5c-498a-a408-1a0d5a5c3554 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:26.234472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e7583d0-9d5c-498a-a408-1a0d5a5c3554 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:26.234914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e7583d0-9d5c-498a-a408-1a0d5a5c3554 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:26.271669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c54499ea-054f-44f4-9e6a-55afbee8d05a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:26.280030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c54499ea-054f-44f4-9e6a-55afbee8d05a tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.164257 Jun 02 16:14:26.288500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 425/849] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:26 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:26.378966 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0e7583d0-9d5c-498a-a408-1a0d5a5c3554 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:26.387061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0e7583d0-9d5c-498a-a408-1a0d5a5c3554 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.166165 Jun 02 16:14:26.387645 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 425/850] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:27.297839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-70d16133-94a2-4bd2-a845-17137cd06b94 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:27.298475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-70d16133-94a2-4bd2-a845-17137cd06b94 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:27.304811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70d16133-94a2-4bd2-a845-17137cd06b94 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:27.305259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70d16133-94a2-4bd2-a845-17137cd06b94 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:27.306015 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70d16133-94a2-4bd2-a845-17137cd06b94 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:27.306476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70d16133-94a2-4bd2-a845-17137cd06b94 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:27.404207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ab1fd3f8-0218-44e3-bb6f-ce9063283d54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:27.408165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ab1fd3f8-0218-44e3-bb6f-ce9063283d54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:27.412820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ab1fd3f8-0218-44e3-bb6f-ce9063283d54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:27.413274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ab1fd3f8-0218-44e3-bb6f-ce9063283d54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:27.414057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ab1fd3f8-0218-44e3-bb6f-ce9063283d54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:27.414540 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ab1fd3f8-0218-44e3-bb6f-ce9063283d54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:27.440659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-70d16133-94a2-4bd2-a845-17137cd06b94 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:27.448728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-70d16133-94a2-4bd2-a845-17137cd06b94 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.155121 Jun 02 16:14:27.449303 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 426/851] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:27 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:27.552019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ab1fd3f8-0218-44e3-bb6f-ce9063283d54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:27.560129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ab1fd3f8-0218-44e3-bb6f-ce9063283d54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.159842 Jun 02 16:14:27.560950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 426/852] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:28.005422 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b426795b-fb11-4442-974c-5a0e4e1b3110 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:28.005885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b426795b-fb11-4442-974c-5a0e4e1b3110 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:28.011949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b426795b-fb11-4442-974c-5a0e4e1b3110 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:28.012399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b426795b-fb11-4442-974c-5a0e4e1b3110 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:28.013165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b426795b-fb11-4442-974c-5a0e4e1b3110 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:28.013646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b426795b-fb11-4442-974c-5a0e4e1b3110 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:28.038701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b426795b-fb11-4442-974c-5a0e4e1b3110 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:14:28.335583 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b426795b-fb11-4442-974c-5a0e4e1b3110 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "DELETE /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 204 len: 0 microversion: 2.1 time: 0.333885 Jun 02 16:14:28.336222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 427/853] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:14:28 2022] DELETE /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:14:28.344050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c65880af-36d9-4d44-915b-2abee338548e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:28.352249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c65880af-36d9-4d44-915b-2abee338548e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:28.352249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c65880af-36d9-4d44-915b-2abee338548e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:28.352249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c65880af-36d9-4d44-915b-2abee338548e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:28.352597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c65880af-36d9-4d44-915b-2abee338548e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:28.353021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c65880af-36d9-4d44-915b-2abee338548e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:28.467248 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4768411f-67e8-4211-8513-c11bb58f3260 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:28.467950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4768411f-67e8-4211-8513-c11bb58f3260 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:28.475498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4768411f-67e8-4211-8513-c11bb58f3260 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:28.475949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4768411f-67e8-4211-8513-c11bb58f3260 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:28.476907 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4768411f-67e8-4211-8513-c11bb58f3260 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:28.477509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4768411f-67e8-4211-8513-c11bb58f3260 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:28.484111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c65880af-36d9-4d44-915b-2abee338548e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:28.499722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c65880af-36d9-4d44-915b-2abee338548e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1507 microversion: 2.1 time: 0.151759 Jun 02 16:14:28.500536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 427/854] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:28 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:28.579024 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7e3f3c64-84c8-4d65-bd2b-c97fd888db46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:28.579641 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7e3f3c64-84c8-4d65-bd2b-c97fd888db46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:28.585958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e3f3c64-84c8-4d65-bd2b-c97fd888db46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:28.586436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e3f3c64-84c8-4d65-bd2b-c97fd888db46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:28.587220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e3f3c64-84c8-4d65-bd2b-c97fd888db46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:28.587663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e3f3c64-84c8-4d65-bd2b-c97fd888db46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:28.620982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4768411f-67e8-4211-8513-c11bb58f3260 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:28.628827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4768411f-67e8-4211-8513-c11bb58f3260 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.165796 Jun 02 16:14:28.630178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 428/855] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:28 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:28.722048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7e3f3c64-84c8-4d65-bd2b-c97fd888db46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:28.729834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7e3f3c64-84c8-4d65-bd2b-c97fd888db46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.154664 Jun 02 16:14:28.731675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 428/856] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:29.517479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7bbe2b05-66d9-4567-9fa1-6b2d10ab58e6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:29.518122 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7bbe2b05-66d9-4567-9fa1-6b2d10ab58e6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:29.525335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7bbe2b05-66d9-4567-9fa1-6b2d10ab58e6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:29.525798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7bbe2b05-66d9-4567-9fa1-6b2d10ab58e6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:29.526655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7bbe2b05-66d9-4567-9fa1-6b2d10ab58e6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:29.527090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7bbe2b05-66d9-4567-9fa1-6b2d10ab58e6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:29.647965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7ce1ce37-73ee-461e-906b-9f41a5671883 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:29.648585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7ce1ce37-73ee-461e-906b-9f41a5671883 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:29.655382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ce1ce37-73ee-461e-906b-9f41a5671883 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:29.655836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ce1ce37-73ee-461e-906b-9f41a5671883 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:29.656613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ce1ce37-73ee-461e-906b-9f41a5671883 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:29.657323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ce1ce37-73ee-461e-906b-9f41a5671883 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:29.743931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7bbe2b05-66d9-4567-9fa1-6b2d10ab58e6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:29.752704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7bbe2b05-66d9-4567-9fa1-6b2d10ab58e6 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1507 microversion: 2.1 time: 0.238957 Jun 02 16:14:29.753623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 429/857] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:29 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:29.759932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-20ffbe13-cbf7-4dc3-8cba-f9b2af51dd7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:29.760907 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-20ffbe13-cbf7-4dc3-8cba-f9b2af51dd7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:29.767104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20ffbe13-cbf7-4dc3-8cba-f9b2af51dd7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:29.767872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20ffbe13-cbf7-4dc3-8cba-f9b2af51dd7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:29.769055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20ffbe13-cbf7-4dc3-8cba-f9b2af51dd7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:29.770236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20ffbe13-cbf7-4dc3-8cba-f9b2af51dd7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:29.804667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7ce1ce37-73ee-461e-906b-9f41a5671883 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:29.812163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7ce1ce37-73ee-461e-906b-9f41a5671883 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.168989 Jun 02 16:14:29.812842 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 429/858] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:29 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:29.925922 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-20ffbe13-cbf7-4dc3-8cba-f9b2af51dd7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:29.933553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-20ffbe13-cbf7-4dc3-8cba-f9b2af51dd7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.177657 Jun 02 16:14:29.936319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 430/859] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:30.776391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-08e5c655-d5e1-4fbb-be2f-3daae3ca18df tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:30.779070 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-08e5c655-d5e1-4fbb-be2f-3daae3ca18df tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:30.790424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-08e5c655-d5e1-4fbb-be2f-3daae3ca18df tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:30.790917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-08e5c655-d5e1-4fbb-be2f-3daae3ca18df tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:30.791751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-08e5c655-d5e1-4fbb-be2f-3daae3ca18df tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:30.792241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-08e5c655-d5e1-4fbb-be2f-3daae3ca18df tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:30.830452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c321f297-ca80-47a5-83eb-e55a8ea52123 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:30.831178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c321f297-ca80-47a5-83eb-e55a8ea52123 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:30.838191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c321f297-ca80-47a5-83eb-e55a8ea52123 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:30.840361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c321f297-ca80-47a5-83eb-e55a8ea52123 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:30.846435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c321f297-ca80-47a5-83eb-e55a8ea52123 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:30.847545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c321f297-ca80-47a5-83eb-e55a8ea52123 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:30.862217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-08e5c655-d5e1-4fbb-be2f-3daae3ca18df tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:30.884877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-08e5c655-d5e1-4fbb-be2f-3daae3ca18df tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1465 microversion: 2.1 time: 0.108202 Jun 02 16:14:30.886194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 430/860] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:30 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1465 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:30.892356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-0692f18f-abf7-40ab-8788-a7e8e6192b3c req-710036a8-8b92-4ec7-866a-d4df9b80387e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d978fa-9abe-42e1-af29-1ccea22ff4c9", "name": "network-vif-plugged", "status": "completed", "tag": "3ce4a557-9dd7-4f99-8a53-2bb41b1937c7"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:30.903590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-0692f18f-abf7-40ab-8788-a7e8e6192b3c req-710036a8-8b92-4ec7-866a-d4df9b80387e service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:30.904979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-0692f18f-abf7-40ab-8788-a7e8e6192b3c req-710036a8-8b92-4ec7-866a-d4df9b80387e service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:30.921402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-0692f18f-abf7-40ab-8788-a7e8e6192b3c req-710036a8-8b92-4ec7-866a-d4df9b80387e service nova] Creating event network-vif-plugged:3ce4a557-9dd7-4f99-8a53-2bb41b1937c7 for instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 on hv-cinder-79760 Jun 02 16:14:30.927960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-0692f18f-abf7-40ab-8788-a7e8e6192b3c req-710036a8-8b92-4ec7-866a-d4df9b80387e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039166 Jun 02 16:14:30.934005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 431/861] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:30.959970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-656413e3-6927-435b-b6d4-4d9354d3d188 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:30.960803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-656413e3-6927-435b-b6d4-4d9354d3d188 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:30.967442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-656413e3-6927-435b-b6d4-4d9354d3d188 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:30.974048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-656413e3-6927-435b-b6d4-4d9354d3d188 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:30.974048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-656413e3-6927-435b-b6d4-4d9354d3d188 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:30.974048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-656413e3-6927-435b-b6d4-4d9354d3d188 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:31.049357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c321f297-ca80-47a5-83eb-e55a8ea52123 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:31.060901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c321f297-ca80-47a5-83eb-e55a8ea52123 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.234513 Jun 02 16:14:31.062977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 431/862] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:30 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:31.069732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-9cce0b59-8c90-4d21-8c59-26aeb896e973 req-02def7cb-4e21-4736-9594-693c78efcd9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d2a6ab-d9d6-4043-90ae-76da9f639df4", "name": "network-vif-deleted", "tag": "f0173a42-e08a-48e6-a40a-dd060bef661a"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:31.080249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-9cce0b59-8c90-4d21-8c59-26aeb896e973 req-02def7cb-4e21-4736-9594-693c78efcd9b service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:31.080980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-9cce0b59-8c90-4d21-8c59-26aeb896e973 req-02def7cb-4e21-4736-9594-693c78efcd9b service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:31.093003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-9cce0b59-8c90-4d21-8c59-26aeb896e973 req-02def7cb-4e21-4736-9594-693c78efcd9b service nova] Creating event network-vif-deleted:f0173a42-e08a-48e6-a40a-dd060bef661a for instance 38d2a6ab-d9d6-4043-90ae-76da9f639df4 on hv-cinder-79760 Jun 02 16:14:31.098982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-9cce0b59-8c90-4d21-8c59-26aeb896e973 req-02def7cb-4e21-4736-9594-693c78efcd9b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034291 Jun 02 16:14:31.100188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 432/863] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:31.140536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-656413e3-6927-435b-b6d4-4d9354d3d188 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:31.148745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-656413e3-6927-435b-b6d4-4d9354d3d188 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.201281 Jun 02 16:14:31.149343 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 432/864] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:31.903650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:31.904337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:31.911694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:31.912144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:31.912938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:31.913375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:31.943945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:31.944394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:31.944839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lazy-loading 'fault' on Instance uuid 38d2a6ab-d9d6-4043-90ae-76da9f639df4 {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:14:32.080018 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4072bb93-8c0c-4b6f-99bc-ca59578c3af7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:32.080641 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4072bb93-8c0c-4b6f-99bc-ca59578c3af7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:32.088274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4072bb93-8c0c-4b6f-99bc-ca59578c3af7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:32.088724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4072bb93-8c0c-4b6f-99bc-ca59578c3af7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:32.089517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4072bb93-8c0c-4b6f-99bc-ca59578c3af7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:32.089954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4072bb93-8c0c-4b6f-99bc-ca59578c3af7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:32.094774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:32.230828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4072bb93-8c0c-4b6f-99bc-ca59578c3af7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:32.237315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:32.238801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4072bb93-8c0c-4b6f-99bc-ca59578c3af7 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.162512 Jun 02 16:14:32.239393 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 433/865] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:32 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:32.244143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4707988a-02d9-4202-92d5-a99fb1425b3f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:32.244727 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-42ab3204-e079-41e9-9055-09e3b5854cff tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 200 len: 1311 microversion: 2.1 time: 0.345400 Jun 02 16:14:32.244854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4707988a-02d9-4202-92d5-a99fb1425b3f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:32.245454 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 433/866] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:31 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 1311 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:32.250635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4707988a-02d9-4202-92d5-a99fb1425b3f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:32.251090 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4707988a-02d9-4202-92d5-a99fb1425b3f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:32.251864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4707988a-02d9-4202-92d5-a99fb1425b3f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:32.252309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4707988a-02d9-4202-92d5-a99fb1425b3f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:32.383769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4707988a-02d9-4202-92d5-a99fb1425b3f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:32.391170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4707988a-02d9-4202-92d5-a99fb1425b3f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.150846 Jun 02 16:14:32.391739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 434/867] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:33.019276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-15a6e102-d388-4335-853e-a947d9a1c00b req-06906cc3-5220-4516-b971-281fd8ea81ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07acc928-a366-4e20-8462-b4e78a2a4e0b", "name": "network-vif-plugged", "status": "completed", "tag": "3b9de9f4-4fd1-4131-9b1c-81b197b00a5f"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:33.021964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-15a6e102-d388-4335-853e-a947d9a1c00b req-06906cc3-5220-4516-b971-281fd8ea81ed service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.022428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-15a6e102-d388-4335-853e-a947d9a1c00b req-06906cc3-5220-4516-b971-281fd8ea81ed service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.033627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-15a6e102-d388-4335-853e-a947d9a1c00b req-06906cc3-5220-4516-b971-281fd8ea81ed service nova] Creating event network-vif-plugged:3b9de9f4-4fd1-4131-9b1c-81b197b00a5f for instance 07acc928-a366-4e20-8462-b4e78a2a4e0b on hv-cinder-79760 Jun 02 16:14:33.039243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-15a6e102-d388-4335-853e-a947d9a1c00b req-06906cc3-5220-4516-b971-281fd8ea81ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031915 Jun 02 16:14:33.039835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 434/868] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:33.255917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-564b10af-7633-474a-826c-ff39d9e46f12 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:33.256458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-564b10af-7633-474a-826c-ff39d9e46f12 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:33.261612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:33.262340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: 38d2a6ab-d9d6-4043-90ae-76da9f639df4] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:33.263293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-564b10af-7633-474a-826c-ff39d9e46f12 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.263744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-564b10af-7633-474a-826c-ff39d9e46f12 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.264519 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-564b10af-7633-474a-826c-ff39d9e46f12 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.264961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-564b10af-7633-474a-826c-ff39d9e46f12 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.268623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.269080 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.270697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.270991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.284562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] HTTP exception thrown: Instance 38d2a6ab-d9d6-4043-90ae-76da9f639df4 could not be found. Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Request method failure captured: Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 HTTP/1.1 Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOAO7LmHqb4S_f4qwkNYdaHIV121i5tIUgTvVzS00aYcMN7m5pOkeLk6zCuP0R6IV1y0MhhoRJeqYPLyhsXvbyg4WsnBPK6GU_Ip3YjrFLh8AS5JLVg_uIYrdxD1j654pRlGuETGhlXxCeeVYcAJWrmuY6ublaGdQg5AuSzUoIcy7hc Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:14:33.287182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_629a7b91ffc64154a55a45415f739949"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/629a7b91ffc64154a55a45415f739949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}] Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: a8658730ea2a4a06b7b4070976c6397f Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance 38d2a6ab-d9d6-4043-90ae-76da9f639df4 could not be found. Jun 02 16:14:33.288609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '38d2a6ab-d9d6-4043-90ae-76da9f639df4'} Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d2a6ab-d9d6-4043-90ae-76da9f639df4 could not be found. Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:14:33.289376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d2a6ab-d9d6-4043-90ae-76da9f639df4 could not be found. Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d2a6ab-d9d6-4043-90ae-76da9f639df4 could not be found. Jun 02 16:14:33.290703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:33.291844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Returning 404 to user: Instance 38d2a6ab-d9d6-4043-90ae-76da9f639df4 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:14:33.291844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eab73730-fe45-4b2f-a1e7-1cc927bff52e tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4" status: 404 len: 111 microversion: 2.1 time: 0.031318 Jun 02 16:14:33.291844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 435/869] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:33 2022] GET /compute/v2.1/servers/38d2a6ab-d9d6-4043-90ae-76da9f639df4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:14:33.297192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0827028b-276d-4120-ac8c-d833baab0f2f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:33.297688 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0827028b-276d-4120-ac8c-d833baab0f2f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:33.304265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0827028b-276d-4120-ac8c-d833baab0f2f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.304720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0827028b-276d-4120-ac8c-d833baab0f2f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.305491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0827028b-276d-4120-ac8c-d833baab0f2f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.305929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0827028b-276d-4120-ac8c-d833baab0f2f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.331347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0827028b-276d-4120-ac8c-d833baab0f2f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:14:33.408056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-564b10af-7633-474a-826c-ff39d9e46f12 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:33.416277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-564b10af-7633-474a-826c-ff39d9e46f12 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.164332 Jun 02 16:14:33.416844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 435/870] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:33 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:33.421218 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-548a2bb3-db29-47c1-b814-c28a5d9519ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:33.426182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-548a2bb3-db29-47c1-b814-c28a5d9519ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:33.427742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-548a2bb3-db29-47c1-b814-c28a5d9519ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.428192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-548a2bb3-db29-47c1-b814-c28a5d9519ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.428957 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-548a2bb3-db29-47c1-b814-c28a5d9519ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.429390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-548a2bb3-db29-47c1-b814-c28a5d9519ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.559651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-548a2bb3-db29-47c1-b814-c28a5d9519ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:33.567817 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-548a2bb3-db29-47c1-b814-c28a5d9519ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1362 microversion: 2.1 time: 0.149887 Jun 02 16:14:33.568381 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 436/871] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:33.672286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0827028b-276d-4120-ac8c-d833baab0f2f tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 204 len: 0 microversion: 2.1 time: 0.378355 Jun 02 16:14:33.672894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 436/872] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:14:33 2022] DELETE /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:14:33.680730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-499eeed5-98aa-4ee0-a44b-a1fd51cf14f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:33.681341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-499eeed5-98aa-4ee0-a44b-a1fd51cf14f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:33.687378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-499eeed5-98aa-4ee0-a44b-a1fd51cf14f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.687830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-499eeed5-98aa-4ee0-a44b-a1fd51cf14f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.688592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-499eeed5-98aa-4ee0-a44b-a1fd51cf14f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:33.689032 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-499eeed5-98aa-4ee0-a44b-a1fd51cf14f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:33.827812 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-499eeed5-98aa-4ee0-a44b-a1fd51cf14f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:33.836514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-499eeed5-98aa-4ee0-a44b-a1fd51cf14f7 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.159503 Jun 02 16:14:33.837334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 437/873] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:33 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:34.433569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a2c1b6b8-ca1e-41cc-adfb-8fb155306659 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:34.434210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a2c1b6b8-ca1e-41cc-adfb-8fb155306659 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:34.440565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2c1b6b8-ca1e-41cc-adfb-8fb155306659 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:34.441011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2c1b6b8-ca1e-41cc-adfb-8fb155306659 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:34.441853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2c1b6b8-ca1e-41cc-adfb-8fb155306659 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:34.442437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2c1b6b8-ca1e-41cc-adfb-8fb155306659 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:34.586017 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-589b1455-e95c-4923-97af-62629d0c6deb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:34.586685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-589b1455-e95c-4923-97af-62629d0c6deb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:34.593478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-589b1455-e95c-4923-97af-62629d0c6deb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:34.593934 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-589b1455-e95c-4923-97af-62629d0c6deb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:34.594997 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-589b1455-e95c-4923-97af-62629d0c6deb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:34.595437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-589b1455-e95c-4923-97af-62629d0c6deb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:34.730719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-589b1455-e95c-4923-97af-62629d0c6deb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:34.734163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a2c1b6b8-ca1e-41cc-adfb-8fb155306659 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:34.738883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-589b1455-e95c-4923-97af-62629d0c6deb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1547 microversion: 2.1 time: 0.157566 Jun 02 16:14:34.739692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 438/874] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:34.742662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a2c1b6b8-ca1e-41cc-adfb-8fb155306659 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.313407 Jun 02 16:14:34.743213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 437/875] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:34 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:34.755396 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-59e56557-7086-48f9-8bb6-20c2e07e2d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:34.755897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-59e56557-7086-48f9-8bb6-20c2e07e2d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:34.762801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59e56557-7086-48f9-8bb6-20c2e07e2d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:34.763252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59e56557-7086-48f9-8bb6-20c2e07e2d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:34.764060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59e56557-7086-48f9-8bb6-20c2e07e2d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:34.764496 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59e56557-7086-48f9-8bb6-20c2e07e2d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:34.847403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-59e56557-7086-48f9-8bb6-20c2e07e2d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094194 Jun 02 16:14:34.847403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 439/876] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 2 16:14:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:14:34.854774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eca99201-9b02-4e18-9165-9124b05bbcd4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:34.855367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eca99201-9b02-4e18-9165-9124b05bbcd4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:34.863186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eca99201-9b02-4e18-9165-9124b05bbcd4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:34.864046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eca99201-9b02-4e18-9165-9124b05bbcd4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:34.864981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eca99201-9b02-4e18-9165-9124b05bbcd4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:34.865795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eca99201-9b02-4e18-9165-9124b05bbcd4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:34.995043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-eca99201-9b02-4e18-9165-9124b05bbcd4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:35.002431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eca99201-9b02-4e18-9165-9124b05bbcd4 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1523 microversion: 2.1 time: 0.151535 Jun 02 16:14:35.003179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 438/877] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:34 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:35.760474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-01e55b76-63bb-4c4b-b836-9c1e6de7047e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:35.761135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-01e55b76-63bb-4c4b-b836-9c1e6de7047e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:35.773192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01e55b76-63bb-4c4b-b836-9c1e6de7047e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:35.773651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01e55b76-63bb-4c4b-b836-9c1e6de7047e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:35.774470 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01e55b76-63bb-4c4b-b836-9c1e6de7047e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:35.774951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01e55b76-63bb-4c4b-b836-9c1e6de7047e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:36.020843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d4fac86b-7250-43cb-85e7-ad731d4ebdf1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:36.022261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d4fac86b-7250-43cb-85e7-ad731d4ebdf1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:36.029426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d4fac86b-7250-43cb-85e7-ad731d4ebdf1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:36.030260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d4fac86b-7250-43cb-85e7-ad731d4ebdf1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:36.031247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d4fac86b-7250-43cb-85e7-ad731d4ebdf1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:36.031892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d4fac86b-7250-43cb-85e7-ad731d4ebdf1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:36.033667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01e55b76-63bb-4c4b-b836-9c1e6de7047e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:36.037546 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:36.042116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-01e55b76-63bb-4c4b-b836-9c1e6de7047e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1576 microversion: 2.1 time: 0.285462 Jun 02 16:14:36.049278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 440/878] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:35 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1576 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:36.115904 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d4fac86b-7250-43cb-85e7-ad731d4ebdf1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:36.125993 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d4fac86b-7250-43cb-85e7-ad731d4ebdf1 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1481 microversion: 2.1 time: 0.109932 Jun 02 16:14:36.127048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 439/879] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:36 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1481 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:36.251636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-e99f6add-0cd8-40c3-9a7f-c55204fc3770 req-97af009e-c207-457c-9d36-2f83aaffe0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc302fd8-397a-45ed-9316-d78c9f5b324a", "name": "network-vif-deleted", "tag": "fbd1d709-759c-4885-a8dc-e6d908c97d61"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:36.264956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:36.268508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e99f6add-0cd8-40c3-9a7f-c55204fc3770 req-97af009e-c207-457c-9d36-2f83aaffe0f9 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:36.268508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e99f6add-0cd8-40c3-9a7f-c55204fc3770 req-97af009e-c207-457c-9d36-2f83aaffe0f9 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:36.289466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-e99f6add-0cd8-40c3-9a7f-c55204fc3770 req-97af009e-c207-457c-9d36-2f83aaffe0f9 service nova] Creating event network-vif-deleted:fbd1d709-759c-4885-a8dc-e6d908c97d61 for instance fc302fd8-397a-45ed-9316-d78c9f5b324a on hv-cinder-79760 Jun 02 16:14:36.295668 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-e99f6add-0cd8-40c3-9a7f-c55204fc3770 req-97af009e-c207-457c-9d36-2f83aaffe0f9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049078 Jun 02 16:14:36.302609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-dfdc8f84-6113-4fb7-a99d-5f6626dd4594 req-99268077-3136-49cd-869c-61fbc15f2fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d978fa-9abe-42e1-af29-1ccea22ff4c9", "tag": "3ce4a557-9dd7-4f99-8a53-2bb41b1937c7"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:36.308680 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 441/880] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:36.313701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-dfdc8f84-6113-4fb7-a99d-5f6626dd4594 req-99268077-3136-49cd-869c-61fbc15f2fb6 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:36.314322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-dfdc8f84-6113-4fb7-a99d-5f6626dd4594 req-99268077-3136-49cd-869c-61fbc15f2fb6 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:36.328421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-dfdc8f84-6113-4fb7-a99d-5f6626dd4594 req-99268077-3136-49cd-869c-61fbc15f2fb6 service nova] Creating event network-changed:3ce4a557-9dd7-4f99-8a53-2bb41b1937c7 for instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 on hv-cinder-79760 Jun 02 16:14:36.343328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-dfdc8f84-6113-4fb7-a99d-5f6626dd4594 req-99268077-3136-49cd-869c-61fbc15f2fb6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041599 Jun 02 16:14:36.343328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 440/881] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:14:37.061151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fc1da66e-92e4-42f1-a7a8-f1ec800d1662 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:37.062198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fc1da66e-92e4-42f1-a7a8-f1ec800d1662 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:37.069691 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc1da66e-92e4-42f1-a7a8-f1ec800d1662 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:37.070178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc1da66e-92e4-42f1-a7a8-f1ec800d1662 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:37.070969 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc1da66e-92e4-42f1-a7a8-f1ec800d1662 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:37.071439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc1da66e-92e4-42f1-a7a8-f1ec800d1662 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:37.147054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:37.153203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:37.154240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:37.154690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:37.155787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:37.155983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:37.195642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:37.196088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:37.196546 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lazy-loading 'fault' on Instance uuid fc302fd8-397a-45ed-9316-d78c9f5b324a {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:14:37.224994 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fc1da66e-92e4-42f1-a7a8-f1ec800d1662 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:37.236845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fc1da66e-92e4-42f1-a7a8-f1ec800d1662 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1563 microversion: 2.1 time: 0.180286 Jun 02 16:14:37.237436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 442/882] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:37 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:14:37.250767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8658730ea2a4a06b7b4070976c6397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a7b91ffc64154a55a45415f739949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:14:37.260188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b3e69410-765d-4a9a-a9e1-cc007098faf5 tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 200 len: 1312 microversion: 2.1 time: 0.119148 Jun 02 16:14:37.260806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 441/883] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:37 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:14:38.278221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:38.278860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] [instance: fc302fd8-397a-45ed-9316-d78c9f5b324a] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:14:38.285686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:38.286297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:38.287075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:14:38.287513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:14:38.301537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] HTTP exception thrown: Instance fc302fd8-397a-45ed-9316-d78c9f5b324a could not be found. Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Request method failure captured: Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a HTTP/1.1 Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOAO7LmHqb4S_f4qwkNYdaHIV121i5tIUgTvVzS00aYcMN7m5pOkeLk6zCuP0R6IV1y0MhhoRJeqYPLyhsXvbyg4WsnBPK6GU_Ip3YjrFLh8AS5JLVg_uIYrdxD1j654pRlGuETGhlXxCeeVYcAJWrmuY6ublaGdQg5AuSzUoIcy7hc Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:14:38.303151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_629a7b91ffc64154a55a45415f739949"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/629a7b91ffc64154a55a45415f739949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/629a7b91ffc64154a55a45415f739949"}]}] Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 629a7b91ffc64154a55a45415f739949 Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-950103985 Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: a8658730ea2a4a06b7b4070976c6397f Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-ServerRescueNegativeTestJSON-950103985-project Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance fc302fd8-397a-45ed-9316-d78c9f5b324a could not be found. Jun 02 16:14:38.304669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': 'fc302fd8-397a-45ed-9316-d78c9f5b324a'} Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc302fd8-397a-45ed-9316-d78c9f5b324a could not be found. Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:14:38.305572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc302fd8-397a-45ed-9316-d78c9f5b324a could not be found. Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc302fd8-397a-45ed-9316-d78c9f5b324a could not be found. Jun 02 16:14:38.307014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:38.308280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] Returning 404 to user: Instance fc302fd8-397a-45ed-9316-d78c9f5b324a could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:14:38.308280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f393372e-5d82-4b71-950e-eb61837da51c tempest-ServerRescueNegativeTestJSON-950103985 tempest-ServerRescueNegativeTestJSON-950103985-project] 10.222.0.59 "GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a" status: 404 len: 111 microversion: 2.1 time: 0.030629 Jun 02 16:14:38.308280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 443/884] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:14:38 2022] GET /compute/v2.1/servers/fc302fd8-397a-45ed-9316-d78c9f5b324a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:14:43.878011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3c70eba7-89bd-4104-915f-c5528456cb17 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Action: 'create', calling method: .version_select at 0x7f2d60d2aee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-5631337"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:44.568765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3c70eba7-89bd-4104-915f-c5528456cb17 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 342 microversion: 2.1 time: 0.806061 Jun 02 16:14:44.569393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 442/885] 10.222.0.59 () {60 vars in 1154 bytes} [Thu Jun 2 16:14:43 2022] POST /compute/v2.1/os-volumes => generated 342 bytes in 807 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 16:14:44.580083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ae7b70b7-6fb4-4dcc-b684-c988449baf13 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c471820>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:44.629338 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ae7b70b7-6fb4-4dcc-b684-c988449baf13 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2" status: 200 len: 342 microversion: 2.1 time: 0.052000 Jun 02 16:14:44.630183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 444/886] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:14:44 2022] GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 => generated 342 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:45.642718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a6db4cde-1261-46d3-8bfd-fa7c842bdbc7 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c786ee0>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:45.688592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a6db4cde-1261-46d3-8bfd-fa7c842bdbc7 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2" status: 200 len: 342 microversion: 2.1 time: 0.050311 Jun 02 16:14:45.689151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 443/887] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:14:45 2022] GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 => generated 342 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:46.702513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-be370d11-23fa-4a8a-8160-70f5409de310 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c475d30>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:46.750482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-be370d11-23fa-4a8a-8160-70f5409de310 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2" status: 200 len: 343 microversion: 2.1 time: 0.052320 Jun 02 16:14:46.751089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 445/888] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:14:46 2022] GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 => generated 343 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:46.763335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f701551c-0c8e-4218-a18a-553903c2dd4d tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Action: 'create', calling method: .version_select at 0x7f2d60d829d0>, body: {"snapshot": {"volume_id": "98be614a-8828-4b19-9651-69b50fdefdc2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-587335845"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:14:47.119155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f701551c-0c8e-4218-a18a-553903c2dd4d tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.360141 Jun 02 16:14:47.119755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 444/889] 10.222.0.59 () {60 vars in 1161 bytes} [Thu Jun 2 16:14:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:47.130513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-957387bf-9adc-4f26-861b-97ff8933867f tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c6a9550>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:47.160380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-957387bf-9adc-4f26-861b-97ff8933867f tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 200 len: 286 microversion: 2.1 time: 0.034392 Jun 02 16:14:47.161009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 446/890] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 2 16:14:47 2022] GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:47.170532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7a096539-ddc9-42ba-919b-5b8c4a1ee064 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d60d82550>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:47.192385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:47.200842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7a096539-ddc9-42ba-919b-5b8c4a1ee064 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033999 Jun 02 16:14:47.201441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 445/891] 10.222.0.59 () {58 vars in 1139 bytes} [Thu Jun 2 16:14:47 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:47.212496 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ffc52f2f-e714-46b6-a0af-93c38f45da9a tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c4c6940>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:47.244596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ffc52f2f-e714-46b6-a0af-93c38f45da9a tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 200 len: 286 microversion: 2.1 time: 0.035865 Jun 02 16:14:47.245162 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 447/892] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 2 16:14:47 2022] GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:48.257256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d716f484-16c5-4d54-8233-ed92b23db973 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d60c04280>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:48.287406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d716f484-16c5-4d54-8233-ed92b23db973 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 200 len: 286 microversion: 2.1 time: 0.034812 Jun 02 16:14:48.287969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 446/893] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 2 16:14:48 2022] GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:49.296668 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=5 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:49.297412 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=54 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:49.301889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cb8267d1-088d-425a-b45a-282fa5375666 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c4be790>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:49.330758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cb8267d1-088d-425a-b45a-282fa5375666 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 200 len: 286 microversion: 2.1 time: 0.035237 Jun 02 16:14:49.331313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 448/894] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 2 16:14:49 2022] GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:50.343384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9d514f9b-8598-4dbd-afca-95f7e9221ba2 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d60d2a160>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:50.375257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9d514f9b-8598-4dbd-afca-95f7e9221ba2 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 200 len: 286 microversion: 2.1 time: 0.035067 Jun 02 16:14:50.375257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 447/895] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 2 16:14:50 2022] GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:51.387436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bd05edaf-dc54-4cb1-9479-a6501b86e04c tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c438af0>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:51.420240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bd05edaf-dc54-4cb1-9479-a6501b86e04c tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 200 len: 286 microversion: 2.1 time: 0.037421 Jun 02 16:14:51.420945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 449/896] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 2 16:14:51 2022] GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:14:52.433513 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-14b1d5b6-206b-4474-b3e7-4930bc94af25 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d60c8c4c0>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:52.463078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-14b1d5b6-206b-4474-b3e7-4930bc94af25 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 200 len: 287 microversion: 2.1 time: 0.034094 Jun 02 16:14:52.463627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 448/897] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 2 16:14:52 2022] GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:52.474858 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-eeb4f7e9-ba7c-472a-b927-c7eb437192ed tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c6a99d0>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:52.638466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-eeb4f7e9-ba7c-472a-b927-c7eb437192ed tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 202 len: 0 microversion: 2.1 time: 0.168536 Jun 02 16:14:52.639031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 450/898] 10.222.0.59 () {58 vars in 1253 bytes} [Thu Jun 2 16:14:52 2022] DELETE /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:14:52.647941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-685d6323-c5ae-48fc-b3f2-20b8441d5066 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c786f70>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:52.677257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-685d6323-c5ae-48fc-b3f2-20b8441d5066 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 200 len: 286 microversion: 2.1 time: 0.033959 Jun 02 16:14:52.677810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 449/899] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 2 16:14:52 2022] GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:14:53.689444 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-014b5888-705e-4857-8825-ca1a2729192c tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c471280>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:53.713970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-014b5888-705e-4857-8825-ca1a2729192c tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] HTTP exception thrown: Snapshot 47def4bc-abb1-461c-b5fe-f8f6dcd4c808 could not be found. Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-014b5888-705e-4857-8825-ca1a2729192c tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Request method failure captured: Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 HTTP/1.1 Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOHzVPw52s0HggQCkSqyob4eN_SyV7V4Mumv727l9s_qIw-zbxKD37vLDOX4mOntYIqifOxUvxrU_JxK_eWEehVOjMHExjgxYQYEuxQhwi6ACNJmfQKVflzYCTHmoV9HYR_tl7zKdoXekQn1zegHN2SiC8jh7w3pmD9eA_lPG3wb7eo Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 7777a6f5b0fe475cb40df7a197e4ebb1 Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:14:53.716228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7777a6f5b0fe475cb40df7a197e4ebb1"}]}] Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 7777a6f5b0fe475cb40df7a197e4ebb1 Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-VolumesSnapshotsTestJSON-230249814-project Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 70015a7d1e504bff9030fc81445d0c19 Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-VolumesSnapshotsTestJSON-230249814-project Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Snapshot 47def4bc-abb1-461c-b5fe-f8f6dcd4c808 could not be found. Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '47def4bc-abb1-461c-b5fe-f8f6dcd4c808'} Jun 02 16:14:53.717488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 47def4bc-abb1-461c-b5fe-f8f6dcd4c808 could not be found. (HTTP 404) (Request-ID: req-dd93dd6a-52d2-4623-ad1e-31d57c76d3ba) Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:53.718419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:14:53.720109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 47def4bc-abb1-461c-b5fe-f8f6dcd4c808 could not be found. Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 02 16:14:53.721692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 47def4bc-abb1-461c-b5fe-f8f6dcd4c808 could not be found. Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 47def4bc-abb1-461c-b5fe-f8f6dcd4c808 could not be found. Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-014b5888-705e-4857-8825-ca1a2729192c tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Returning 404 to user: Snapshot 47def4bc-abb1-461c-b5fe-f8f6dcd4c808 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-014b5888-705e-4857-8825-ca1a2729192c tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808" status: 404 len: 111 microversion: 2.1 time: 0.032525 Jun 02 16:14:53.730506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 451/900] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jun 2 16:14:53 2022] GET /compute/v2.1/os-snapshots/47def4bc-abb1-461c-b5fe-f8f6dcd4c808 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:14:53.731885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-30198f11-45f1-478a-abf9-c3fc82dc661c tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d60c7b940>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:53.769540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=14 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:53.986334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-30198f11-45f1-478a-abf9-c3fc82dc661c tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2" status: 202 len: 0 microversion: 2.1 time: 0.263373 Jun 02 16:14:53.987023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 450/901] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 2 16:14:53 2022] DELETE /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:14:53.996475 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4432eb2f-daf1-425f-be55-be7b24331623 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c4be9d0>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:54.046865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4432eb2f-daf1-425f-be55-be7b24331623 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2" status: 200 len: 342 microversion: 2.1 time: 0.054579 Jun 02 16:14:54.047420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 452/902] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:14:53 2022] GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 => generated 342 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:14:55.060003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c31caeef-6b3d-457f-a501-7a2cb6b6ed4f tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d60c8ca60>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:55.087823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-c31caeef-6b3d-457f-a501-7a2cb6b6ed4f tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] HTTP exception thrown: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c31caeef-6b3d-457f-a501-7a2cb6b6ed4f tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Request method failure captured: Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 HTTP/1.1 Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOHzVPw52s0HggQCkSqyob4eN_SyV7V4Mumv727l9s_qIw-zbxKD37vLDOX4mOntYIqifOxUvxrU_JxK_eWEehVOjMHExjgxYQYEuxQhwi6ACNJmfQKVflzYCTHmoV9HYR_tl7zKdoXekQn1zegHN2SiC8jh7w3pmD9eA_lPG3wb7eo Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 7777a6f5b0fe475cb40df7a197e4ebb1 Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:14:55.090022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7777a6f5b0fe475cb40df7a197e4ebb1"}]}] Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 7777a6f5b0fe475cb40df7a197e4ebb1 Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesSnapshotsTestJSON-230249814-project Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 70015a7d1e504bff9030fc81445d0c19 Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesSnapshotsTestJSON-230249814-project Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '98be614a-8828-4b19-9651-69b50fdefdc2'} Jun 02 16:14:55.091586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. (HTTP 404) (Request-ID: req-594c3743-da0f-4c0e-a0ee-ef1ec98a2444) Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:55.092632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:14:55.094057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 16:14:55.095774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c31caeef-6b3d-457f-a501-7a2cb6b6ed4f tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Returning 404 to user: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c31caeef-6b3d-457f-a501-7a2cb6b6ed4f tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2" status: 404 len: 109 microversion: 2.1 time: 0.036004 Jun 02 16:14:55.097308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 451/903] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:14:55 2022] GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:14:55.107528 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5b7d6142-8843-40a5-b041-b794f84a8663 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d5c471280>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:55.135548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-5b7d6142-8843-40a5-b041-b794f84a8663 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] HTTP exception thrown: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5b7d6142-8843-40a5-b041-b794f84a8663 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Request method failure captured: Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 HTTP/1.1 Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOHzVPw52s0HggQCkSqyob4eN_SyV7V4Mumv727l9s_qIw-zbxKD37vLDOX4mOntYIqifOxUvxrU_JxK_eWEehVOjMHExjgxYQYEuxQhwi6ACNJmfQKVflzYCTHmoV9HYR_tl7zKdoXekQn1zegHN2SiC8jh7w3pmD9eA_lPG3wb7eo Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 7777a6f5b0fe475cb40df7a197e4ebb1 Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:14:55.137504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7777a6f5b0fe475cb40df7a197e4ebb1"}]}] Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 7777a6f5b0fe475cb40df7a197e4ebb1 Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-VolumesSnapshotsTestJSON-230249814-project Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 70015a7d1e504bff9030fc81445d0c19 Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-VolumesSnapshotsTestJSON-230249814-project Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '98be614a-8828-4b19-9651-69b50fdefdc2'} Jun 02 16:14:55.139042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. (HTTP 404) (Request-ID: req-00e467bb-ac3d-4c8a-ab60-40d6eea8f31e) Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:55.139889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 16:14:55.141027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 16:14:55.142363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5b7d6142-8843-40a5-b041-b794f84a8663 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Returning 404 to user: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5b7d6142-8843-40a5-b041-b794f84a8663 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2" status: 404 len: 109 microversion: 2.1 time: 0.035824 Jun 02 16:14:55.143678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 453/904] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 2 16:14:55 2022] DELETE /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:14:55.147490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5237ce67-2fa9-45bd-a1c6-74c05f08dc96 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Calling method '.version_select at 0x7f2d60c04820>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:14:55.175729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-5237ce67-2fa9-45bd-a1c6-74c05f08dc96 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] HTTP exception thrown: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5237ce67-2fa9-45bd-a1c6-74c05f08dc96 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Request method failure captured: Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 HTTP/1.1 Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOHzVPw52s0HggQCkSqyob4eN_SyV7V4Mumv727l9s_qIw-zbxKD37vLDOX4mOntYIqifOxUvxrU_JxK_eWEehVOjMHExjgxYQYEuxQhwi6ACNJmfQKVflzYCTHmoV9HYR_tl7zKdoXekQn1zegHN2SiC8jh7w3pmD9eA_lPG3wb7eo Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 7777a6f5b0fe475cb40df7a197e4ebb1 Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:14:55.178390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7777a6f5b0fe475cb40df7a197e4ebb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7777a6f5b0fe475cb40df7a197e4ebb1"}]}] Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 7777a6f5b0fe475cb40df7a197e4ebb1 Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-230249814 Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesSnapshotsTestJSON-230249814-project Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 70015a7d1e504bff9030fc81445d0c19 Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesSnapshotsTestJSON-230249814-project Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '98be614a-8828-4b19-9651-69b50fdefdc2'} Jun 02 16:14:55.180103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. (HTTP 404) (Request-ID: req-f2874ebf-5a82-4f07-8cdf-bbe783877706) Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:55.181022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 16:14:55.182392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 16:14:55.183757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5237ce67-2fa9-45bd-a1c6-74c05f08dc96 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] Returning 404 to user: Volume 98be614a-8828-4b19-9651-69b50fdefdc2 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5237ce67-2fa9-45bd-a1c6-74c05f08dc96 tempest-VolumesSnapshotsTestJSON-230249814 tempest-VolumesSnapshotsTestJSON-230249814-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2" status: 404 len: 109 microversion: 2.1 time: 0.036293 Jun 02 16:14:55.185261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 452/905] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jun 2 16:14:55 2022] GET /compute/v2.1/os-volumes/98be614a-8828-4b19-9651-69b50fdefdc2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:15:34.427220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9d45314e-f5fb-4591-9674-c7aada9c5273 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:34.427808 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9d45314e-f5fb-4591-9674-c7aada9c5273 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:34.433750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d45314e-f5fb-4591-9674-c7aada9c5273 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:34.434297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d45314e-f5fb-4591-9674-c7aada9c5273 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:34.435058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d45314e-f5fb-4591-9674-c7aada9c5273 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:34.435502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d45314e-f5fb-4591-9674-c7aada9c5273 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:34.459030 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9d45314e-f5fb-4591-9674-c7aada9c5273 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/ips" status: 200 len: 153 microversion: 2.20 time: 0.037603 Jun 02 16:15:34.459650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 454/906] 10.222.0.59 () {60 vars in 1288 bytes} [Thu Jun 2 16:15:34 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:15:37.795210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8d79652e-68a6-4922-abf1-26b795f43d27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:15:37.795932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8d79652e-68a6-4922-abf1-26b795f43d27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:37.803681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d79652e-68a6-4922-abf1-26b795f43d27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:37.804129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d79652e-68a6-4922-abf1-26b795f43d27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:37.804889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d79652e-68a6-4922-abf1-26b795f43d27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:37.805320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d79652e-68a6-4922-abf1-26b795f43d27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:37.829609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-8d79652e-68a6-4922-abf1-26b795f43d27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lazy-loading 'flavor' on Instance uuid 942de225-4aff-4a9e-85f0-634ab0ac44e3 {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:15:38.379511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8d79652e-68a6-4922-abf1-26b795f43d27 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/action" status: 202 len: 0 microversion: 2.20 time: 0.588025 Jun 02 16:15:38.380111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 453/907] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jun 2 16:15:37 2022] POST /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:15:38.388162 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:38.388869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:38.395451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:38.395897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:38.396667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:38.397129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:38.526781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:38.535651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:38.537164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:38.538361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0265e27d-2481-46fd-8270-c86f4fec0954 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.154062 Jun 02 16:15:38.538920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 455/908] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:38 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:39.558474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:39.559089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:39.565871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:39.566344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:39.567113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:39.567548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:39.697638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:39.705471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:39.706992 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:39.708144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5224a4f3-eeb9-4416-974a-bfa706cebeb8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.154540 Jun 02 16:15:39.708694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 454/909] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:39 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:40.726751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:40.731757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:40.733881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:40.734367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:40.735128 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:40.735558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:40.868753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:40.876991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:40.878670 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:40.879839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-06d54234-4672-43b4-821b-52d5c626c0c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.156887 Jun 02 16:15:40.880383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 456/910] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:40 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:41.897776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:41.898362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:41.904983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:41.905437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:41.906250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:41.906688 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:42.040048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:42.048022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:42.050666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:42.052071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-aaa38f2c-da77-4ad6-af04-947cd90631be tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.158383 Jun 02 16:15:42.052939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 455/911] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:41 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:43.070219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:43.070810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:43.077257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:43.077701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:43.078506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:43.078938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:43.295151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:43.303725 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:43.305219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:43.306399 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7e0bac6d-b699-4506-bb98-a4cfc9d91994 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.240089 Jun 02 16:15:43.306949 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 457/912] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:43 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:44.324846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:44.325450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:44.332894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:44.333346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:44.334201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:44.334637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:44.469786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:44.478588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:44.480187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:44.481371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bd680a27-7288-4901-8304-ba9644e5595c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.160472 Jun 02 16:15:44.481919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 456/913] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:44 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:45.499389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:45.499993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:45.506673 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:45.507116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:45.507868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:45.508296 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:45.638306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:45.647229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:45.648745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:45.649900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-84a66c46-f303-45b0-bbfa-a79f5d1c71ba tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.154517 Jun 02 16:15:45.650563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 458/914] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:45 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:46.669219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:46.669864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:46.677093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:46.677535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:46.678381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:46.678817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:46.855383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:46.864577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:46.866189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:46.867445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-101bf8bd-390a-4c25-bd8e-235418419a32 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.202163 Jun 02 16:15:46.868022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 457/915] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:46 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:47.885099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:47.885763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:47.892260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:47.892953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:47.893770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:47.894461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:48.037254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:48.045474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:48.047024 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:48.048358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5eef9836-62ec-46ab-9512-244151ef14fa tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.167312 Jun 02 16:15:48.048947 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 459/916] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:47 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:49.066579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:49.067185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:49.073937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:49.074423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:49.075207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:49.075624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:49.208892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:49.216682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:49.218206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:49.219359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a7aae4f3-baff-454f-8d52-039571df3955 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.157318 Jun 02 16:15:49.219940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 458/917] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:49 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:15:49.813353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-391326268", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "networks": [{"uuid": "e2ac7678-4aba-4dea-bbee-525843f1daf4"}]}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:15:49.866175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] validate_networks() for [('e2ac7678-4aba-4dea-bbee-525843f1daf4', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:15:50.209878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:15:50.210541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:15:50.211316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:15:50.211828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:15:50.212309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:15:50.223986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:50.224441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:50.225284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:50.225774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:50.237755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:50.238687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:50.245538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Getting quotas for project f556a2c3bb1c45f0a3607912effac5c8. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:15:50.247355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:50.247994 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:50.248156 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Getting quotas for user 2910f2833ce24b17b248ad9106f19786 and project f556a2c3bb1c45f0a3607912effac5c8. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:15:50.248784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:50.249208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:50.259690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:15:50.262036 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:15:50.382469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:50.390365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:50.391883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:50.393023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d1bbe814-29b1-409e-9d7f-d353de06194a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1746 microversion: 2.20 time: 0.159559 Jun 02 16:15:50.394253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 459/918] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:50 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:50.426555 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-24d8c1cd-d119-421b-a750-72ff1ad5837d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616957 Jun 02 16:15:50.427365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 460/919] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:15:50.436783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-31409f50-f73d-4a35-b76a-5e094faea2f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:50.437396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-31409f50-f73d-4a35-b76a-5e094faea2f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:50.490023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-31409f50-f73d-4a35-b76a-5e094faea2f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:50.496809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-31409f50-f73d-4a35-b76a-5e094faea2f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1218 microversion: 2.1 time: 0.063782 Jun 02 16:15:50.497368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 460/920] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:15:50 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:15:51.412963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:51.413723 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:51.420065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:51.420509 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:51.421281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:51.421716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:51.514411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-150b1dd1-eab7-45cb-abac-91fa58de388d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:51.515033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-150b1dd1-eab7-45cb-abac-91fa58de388d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:51.555374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:51.566588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:51.570725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-150b1dd1-eab7-45cb-abac-91fa58de388d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:51.574621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:51.575829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-72f3c2e1-36f8-477d-9999-f0302de69d1c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1746 microversion: 2.20 time: 0.167907 Jun 02 16:15:51.576427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 461/921] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:51 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:51.579930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-150b1dd1-eab7-45cb-abac-91fa58de388d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1218 microversion: 2.1 time: 0.069655 Jun 02 16:15:51.580666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 461/922] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:15:51 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:15:52.594359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:52.595683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:52.597589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4a61e7fe-9e7c-4683-8f55-dad7d14693f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:52.598241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4a61e7fe-9e7c-4683-8f55-dad7d14693f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:52.603107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:52.603563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:52.604340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:52.604760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a61e7fe-9e7c-4683-8f55-dad7d14693f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:52.604873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:52.605215 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a61e7fe-9e7c-4683-8f55-dad7d14693f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:52.605982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a61e7fe-9e7c-4683-8f55-dad7d14693f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:52.606448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a61e7fe-9e7c-4683-8f55-dad7d14693f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:52.678653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4a61e7fe-9e7c-4683-8f55-dad7d14693f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:52.686182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4a61e7fe-9e7c-4683-8f55-dad7d14693f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1270 microversion: 2.1 time: 0.093326 Jun 02 16:15:52.686754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 462/923] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:15:52 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:15:52.757799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:52.765840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:52.767436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:52.768628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-69bbc556-03ef-40ce-a591-46da3625614f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1746 microversion: 2.20 time: 0.178383 Jun 02 16:15:52.769596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 462/924] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:52 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:53.410719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-c0bafae8-2961-4228-b18f-cdda0383e4c3 req-a9ec4002-4f4b-43f4-a3c0-742ca1adc6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942de225-4aff-4a9e-85f0-634ab0ac44e3", "name": "network-vif-plugged", "status": "completed", "tag": "97598fb5-567e-4cea-b72c-57887c16e355"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:15:53.419010 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-c0bafae8-2961-4228-b18f-cdda0383e4c3 req-a9ec4002-4f4b-43f4-a3c0-742ca1adc6bd service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:53.419454 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-c0bafae8-2961-4228-b18f-cdda0383e4c3 req-a9ec4002-4f4b-43f4-a3c0-742ca1adc6bd service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:53.431230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-c0bafae8-2961-4228-b18f-cdda0383e4c3 req-a9ec4002-4f4b-43f4-a3c0-742ca1adc6bd service nova] Creating event network-vif-plugged:97598fb5-567e-4cea-b72c-57887c16e355 for instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 on hv-cinder-79760 Jun 02 16:15:53.436480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-c0bafae8-2961-4228-b18f-cdda0383e4c3 req-a9ec4002-4f4b-43f4-a3c0-742ca1adc6bd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030250 Jun 02 16:15:53.437306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 463/925] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:15:53.703396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a6ffd74a-8c4c-40e8-b488-a24695437313 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:53.704009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a6ffd74a-8c4c-40e8-b488-a24695437313 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:53.711138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6ffd74a-8c4c-40e8-b488-a24695437313 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:53.711591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6ffd74a-8c4c-40e8-b488-a24695437313 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:53.712354 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6ffd74a-8c4c-40e8-b488-a24695437313 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:53.712792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6ffd74a-8c4c-40e8-b488-a24695437313 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:53.789249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:53.790106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:53.797062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:53.797507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:53.798315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:53.798750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:53.929705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:53.937966 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a6ffd74a-8c4c-40e8-b488-a24695437313 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:53.938175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:53.939579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:53.940936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-01a1fc68-ef98-4c11-bad0-4ff41bbe98e3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1746 microversion: 2.20 time: 0.156919 Jun 02 16:15:53.947422 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a6ffd74a-8c4c-40e8-b488-a24695437313 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1318 microversion: 2.1 time: 0.247807 Jun 02 16:15:53.948310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 463/926] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:15:53 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:15:53.951684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 464/927] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:53 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:15:54.602181 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-54eba306-1426-4617-b973-4f3d1f149616 req-2576f941-31fe-4fa4-9cc8-adae2fb2e9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9f21d8-cd12-4d8c-8dc7-765453991dcb", "tag": "72896168-abc4-4538-b499-5f8549bf384e"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:15:54.610444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-54eba306-1426-4617-b973-4f3d1f149616 req-2576f941-31fe-4fa4-9cc8-adae2fb2e9c8 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:54.610894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-54eba306-1426-4617-b973-4f3d1f149616 req-2576f941-31fe-4fa4-9cc8-adae2fb2e9c8 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:54.624076 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-54eba306-1426-4617-b973-4f3d1f149616 req-2576f941-31fe-4fa4-9cc8-adae2fb2e9c8 service nova] Creating event network-changed:72896168-abc4-4538-b499-5f8549bf384e for instance 6d9f21d8-cd12-4d8c-8dc7-765453991dcb on hv-cinder-79760 Jun 02 16:15:54.630412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-54eba306-1426-4617-b973-4f3d1f149616 req-2576f941-31fe-4fa4-9cc8-adae2fb2e9c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032022 Jun 02 16:15:54.631011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 464/928] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:15:54.958332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:54.958943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:54.965571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e6c24212-6da3-4f38-92a0-c62788681934 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:54.966065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:54.966312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:54.967016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:54.967142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e6c24212-6da3-4f38-92a0-c62788681934 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:54.967445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:54.974979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6c24212-6da3-4f38-92a0-c62788681934 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:54.975520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6c24212-6da3-4f38-92a0-c62788681934 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:54.976286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6c24212-6da3-4f38-92a0-c62788681934 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:54.976716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6c24212-6da3-4f38-92a0-c62788681934 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:55.106775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:55.116233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:55.117789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:55.118982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8b8e72b2-b62e-44a9-8331-8fb5bbc5964f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1746 microversion: 2.20 time: 0.164724 Jun 02 16:15:55.119542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 465/929] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:54 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:55.138755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e6c24212-6da3-4f38-92a0-c62788681934 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:55.147226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e6c24212-6da3-4f38-92a0-c62788681934 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1318 microversion: 2.1 time: 0.186315 Jun 02 16:15:55.147783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 465/930] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:15:54 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:15:56.136993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:56.137632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:56.144708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:56.145157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:56.145927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:56.146456 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:56.163704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bc4e3964-3042-4dde-b175-81a9606f3ac4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:56.164325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bc4e3964-3042-4dde-b175-81a9606f3ac4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:56.170957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc4e3964-3042-4dde-b175-81a9606f3ac4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:56.171552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc4e3964-3042-4dde-b175-81a9606f3ac4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:56.172401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc4e3964-3042-4dde-b175-81a9606f3ac4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:56.172918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc4e3964-3042-4dde-b175-81a9606f3ac4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:56.280400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:56.289350 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:56.290963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:56.292138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b6fbda69-85ed-4264-a89c-ae174d74ca06 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1746 microversion: 2.20 time: 0.159128 Jun 02 16:15:56.292704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 466/931] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:56 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:56.308085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bc4e3964-3042-4dde-b175-81a9606f3ac4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:56.315736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bc4e3964-3042-4dde-b175-81a9606f3ac4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1318 microversion: 2.1 time: 0.155900 Jun 02 16:15:56.316291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 466/932] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:15:56 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:15:57.310947 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:57.311551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:57.319324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:57.319882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:57.320758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:57.321297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:57.333345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ae0bc2cc-e1a3-47d9-9555-a695dca1dfc8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:57.333967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ae0bc2cc-e1a3-47d9-9555-a695dca1dfc8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:57.340598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ae0bc2cc-e1a3-47d9-9555-a695dca1dfc8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:57.341045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ae0bc2cc-e1a3-47d9-9555-a695dca1dfc8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:57.341812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ae0bc2cc-e1a3-47d9-9555-a695dca1dfc8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:57.342308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ae0bc2cc-e1a3-47d9-9555-a695dca1dfc8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:57.453240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:57.463367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:57.464941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:57.466273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ebf495d3-bf8e-4c32-859c-09fbfc08c9d8 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1746 microversion: 2.20 time: 0.159110 Jun 02 16:15:57.474696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ae0bc2cc-e1a3-47d9-9555-a695dca1dfc8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:57.482924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 467/933] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:57 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:57.483238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ae0bc2cc-e1a3-47d9-9555-a695dca1dfc8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1318 microversion: 2.1 time: 0.153573 Jun 02 16:15:57.483238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 467/934] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:15:57 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:15:58.484589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:58.485212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:58.492500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:58.493955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:58.494964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:58.495403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:58.499916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-65f3d4c4-7af2-4ddd-8f30-1eeeff85fc99 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:58.500466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-65f3d4c4-7af2-4ddd-8f30-1eeeff85fc99 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:58.507315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-65f3d4c4-7af2-4ddd-8f30-1eeeff85fc99 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:58.508151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-65f3d4c4-7af2-4ddd-8f30-1eeeff85fc99 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:58.508966 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-65f3d4c4-7af2-4ddd-8f30-1eeeff85fc99 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:58.509407 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-65f3d4c4-7af2-4ddd-8f30-1eeeff85fc99 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:58.655057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:58.664632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:58.666339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:58.667527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a664634a-55b8-427e-a8ac-e761fb874e61 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.186821 Jun 02 16:15:58.668095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 468/935] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:58 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:15:58.668425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-65f3d4c4-7af2-4ddd-8f30-1eeeff85fc99 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:58.676541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-65f3d4c4-7af2-4ddd-8f30-1eeeff85fc99 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1318 microversion: 2.1 time: 0.181132 Jun 02 16:15:58.677112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 468/936] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:15:58 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:15:59.688250 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:59.689148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:59.695028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0ee13a3e-cd4f-4abb-b5bf-36a528d80a91 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:15:59.696201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0ee13a3e-cd4f-4abb-b5bf-36a528d80a91 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:15:59.697315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:59.698399 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:59.699948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:59.701073 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:59.703335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ee13a3e-cd4f-4abb-b5bf-36a528d80a91 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:59.703975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ee13a3e-cd4f-4abb-b5bf-36a528d80a91 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:59.704928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ee13a3e-cd4f-4abb-b5bf-36a528d80a91 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:15:59.705523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ee13a3e-cd4f-4abb-b5bf-36a528d80a91 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:15:59.871485 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0ee13a3e-cd4f-4abb-b5bf-36a528d80a91 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:59.875875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:59.880169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0ee13a3e-cd4f-4abb-b5bf-36a528d80a91 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1318 microversion: 2.1 time: 0.188920 Jun 02 16:15:59.881295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 469/937] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:15:59 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:15:59.888676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:59.892321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:15:59.894322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-11b0d85f-5c4f-415a-8ce9-d87d3e38d02f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.210027 Jun 02 16:15:59.895424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 469/938] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:15:59 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:00.896635 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-40ed5caf-7d82-473c-89ee-e2ad8f169ca2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:00.897493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-40ed5caf-7d82-473c-89ee-e2ad8f169ca2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:00.903917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40ed5caf-7d82-473c-89ee-e2ad8f169ca2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:00.904611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40ed5caf-7d82-473c-89ee-e2ad8f169ca2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:00.905370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40ed5caf-7d82-473c-89ee-e2ad8f169ca2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:00.905957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40ed5caf-7d82-473c-89ee-e2ad8f169ca2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:00.910923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:00.914851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:00.916536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=6 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:00.921616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:00.922509 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:00.931650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:00.932516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:00.933495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:00.934103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:01.071671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-40ed5caf-7d82-473c-89ee-e2ad8f169ca2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:01.081643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-40ed5caf-7d82-473c-89ee-e2ad8f169ca2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1318 microversion: 2.1 time: 0.188813 Jun 02 16:16:01.091593 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 470/939] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:00 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:01.097971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:01.106742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:01.112629 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:01.112629 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c7b10dc2-75b0-4ff9-bf93-5546887f6db7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.195584 Jun 02 16:16:01.112629 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 470/940] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:00 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:01.567125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-48f4b657-e416-487c-a922-6e3dd356469a req-3acd47c2-26cb-425b-93ef-88e8651eec7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9f21d8-cd12-4d8c-8dc7-765453991dcb", "name": "network-vif-plugged", "status": "completed", "tag": "72896168-abc4-4538-b499-5f8549bf384e"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:01.574817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=4 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:01.576834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-48f4b657-e416-487c-a922-6e3dd356469a req-3acd47c2-26cb-425b-93ef-88e8651eec7c service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:01.577386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-48f4b657-e416-487c-a922-6e3dd356469a req-3acd47c2-26cb-425b-93ef-88e8651eec7c service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:01.590024 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-48f4b657-e416-487c-a922-6e3dd356469a req-3acd47c2-26cb-425b-93ef-88e8651eec7c service nova] Creating event network-vif-plugged:72896168-abc4-4538-b499-5f8549bf384e for instance 6d9f21d8-cd12-4d8c-8dc7-765453991dcb on hv-cinder-79760 Jun 02 16:16:01.595054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-48f4b657-e416-487c-a922-6e3dd356469a req-3acd47c2-26cb-425b-93ef-88e8651eec7c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033237 Jun 02 16:16:01.596060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 471/941] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:16:02.100009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5224bc7e-bcd5-4863-8926-468395be0eae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:02.100770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5224bc7e-bcd5-4863-8926-468395be0eae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:02.108568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5224bc7e-bcd5-4863-8926-468395be0eae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:02.109113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5224bc7e-bcd5-4863-8926-468395be0eae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:02.110037 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5224bc7e-bcd5-4863-8926-468395be0eae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:02.110615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5224bc7e-bcd5-4863-8926-468395be0eae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:02.131210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:02.131999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:02.139994 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:02.140553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:02.141414 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:02.141921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:02.291662 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5224bc7e-bcd5-4863-8926-468395be0eae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:02.292786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:02.295995 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5224bc7e-bcd5-4863-8926-468395be0eae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1318 microversion: 2.1 time: 0.201063 Jun 02 16:16:02.296671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 471/942] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:02 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:02.301643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:02.303228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:02.304391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-83957c59-30e4-4b13-9cf1-b98a792cddde tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.178969 Jun 02 16:16:02.304925 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 472/943] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:02 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:03.314004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b4541d38-587e-45f2-a8b5-658fc13a03d3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:03.315442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b4541d38-587e-45f2-a8b5-658fc13a03d3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:03.322102 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4541d38-587e-45f2-a8b5-658fc13a03d3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:03.322560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:03.323313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:03.323601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4541d38-587e-45f2-a8b5-658fc13a03d3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:03.324620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4541d38-587e-45f2-a8b5-658fc13a03d3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:03.325151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4541d38-587e-45f2-a8b5-658fc13a03d3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:03.329910 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:03.330632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:03.331899 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:03.332631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:03.346757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:03.512732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b4541d38-587e-45f2-a8b5-658fc13a03d3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:03.521461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b4541d38-587e-45f2-a8b5-658fc13a03d3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1318 microversion: 2.1 time: 0.211258 Jun 02 16:16:03.532578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 472/944] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:03 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:03.545670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:03.555612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:03.557173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:03.558498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-49c66fdf-b250-46cd-8f2a-e8edd2b74a44 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.240151 Jun 02 16:16:03.570188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 473/945] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:03 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:04.540424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4f6eee87-207d-4f5f-9500-ae75fc8ea0fc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:04.540953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4f6eee87-207d-4f5f-9500-ae75fc8ea0fc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:04.543244 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:04.548561 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f6eee87-207d-4f5f-9500-ae75fc8ea0fc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:04.549005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f6eee87-207d-4f5f-9500-ae75fc8ea0fc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:04.549833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f6eee87-207d-4f5f-9500-ae75fc8ea0fc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:04.550567 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f6eee87-207d-4f5f-9500-ae75fc8ea0fc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:04.577753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:04.579639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:04.598786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:04.599663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:04.600704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:04.602656 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:04.730636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4f6eee87-207d-4f5f-9500-ae75fc8ea0fc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:04.740151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4f6eee87-207d-4f5f-9500-ae75fc8ea0fc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1508 microversion: 2.1 time: 0.203671 Jun 02 16:16:04.741445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 473/946] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:04 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:04.791232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:04.801203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:04.803181 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:04.804589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6375e8de-4ea5-45bd-a7d4-ded35478aaa0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.231101 Jun 02 16:16:04.805201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 474/947] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:04 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:05.827688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:05.828308 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:05.836195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:05.836640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:05.837616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:05.838236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:05.915825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d0bd96c9-ca8d-432d-aab1-cf6fa55bf90b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:05.917144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d0bd96c9-ca8d-432d-aab1-cf6fa55bf90b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:05.927900 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0bd96c9-ca8d-432d-aab1-cf6fa55bf90b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:05.928694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0bd96c9-ca8d-432d-aab1-cf6fa55bf90b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:05.930886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0bd96c9-ca8d-432d-aab1-cf6fa55bf90b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:05.931882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0bd96c9-ca8d-432d-aab1-cf6fa55bf90b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:05.961087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d0bd96c9-ca8d-432d-aab1-cf6fa55bf90b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/ips" status: 200 len: 145 microversion: 2.1 time: 0.049941 Jun 02 16:16:05.983171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 475/948] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 2 16:16:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/ips => generated 145 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:16:06.023081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:06.031900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:06.035205 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:06.036415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3e198719-6769-40e3-8f19-0b0c3abfe17a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.212785 Jun 02 16:16:06.037360 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 474/949] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:05 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:07.058220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:07.059161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:07.066968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:07.067417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:07.068177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:07.068646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:07.236101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:07.244666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:07.246177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:07.247544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ef632afc-95e9-4431-a924-160bc339d988 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.196099 Jun 02 16:16:07.248335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 476/950] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:07 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:07.715633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-224a7b8a-ca51-4eb5-a3ba-9069c4200ab3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f70d3698-4cd7-4c4b-b65f-fba28159611c"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:07.717185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-224a7b8a-ca51-4eb5-a3ba-9069c4200ab3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:07.724923 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-224a7b8a-ca51-4eb5-a3ba-9069c4200ab3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:07.725487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-224a7b8a-ca51-4eb5-a3ba-9069c4200ab3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:07.726361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-224a7b8a-ca51-4eb5-a3ba-9069c4200ab3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:07.727027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-224a7b8a-ca51-4eb5-a3ba-9069c4200ab3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:08.266130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:08.267427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:08.272160 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=53 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:08.276305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:08.276764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:08.277606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:08.278101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:08.438054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:08.447959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:08.449466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:08.450914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bf43f385-1055-4dcf-b027-b2e4d060011c tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.189550 Jun 02 16:16:08.451604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 477/951] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:08 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:09.148860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-224a7b8a-ca51-4eb5-a3ba-9069c4200ab3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.437452 Jun 02 16:16:09.155150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 475/952] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:16:07 2022] POST /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 194 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:16:09.468983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:09.469531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:09.477228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:09.477672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:09.478469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:09.478902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:09.628549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:09.636635 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:09.638403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:09.639728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-48667f97-d262-45bf-8c89-1c74eaea2dc4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.174721 Jun 02 16:16:09.640479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 478/953] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:09 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:10.660363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:10.660960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:10.667303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:10.667756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:10.668526 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:10.668975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:10.805734 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:10.813745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:10.815291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:10.816442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3f9a5c6b-657c-45a4-8bbd-3c325ca85295 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1741 microversion: 2.20 time: 0.161501 Jun 02 16:16:10.817007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 476/954] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:10 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:11.835230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:11.835875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:11.841911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:11.842402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:11.843171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:11.843612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:12.040542 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:12.048735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:12.051222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:12.052188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-64e7b139-fbd5-4b67-be6f-1520d3240d1d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1723 microversion: 2.20 time: 0.221013 Jun 02 16:16:12.052897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 479/955] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:11 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:13.070688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:13.071281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:13.079092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:13.079632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:13.080649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:13.081157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:13.218981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:13.227878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:13.229363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:13.233743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3eb3ad1c-d511-4d9f-a169-91922b942d57 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1723 microversion: 2.20 time: 0.163754 Jun 02 16:16:13.233743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 477/956] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:13 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:13.515027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-76237415-8593-413c-96ee-383e55e862bd req-cb0ee4b0-ddaa-41bc-b5d9-afda168ade3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942de225-4aff-4a9e-85f0-634ab0ac44e3", "name": "network-vif-unplugged", "status": "completed", "tag": "97598fb5-567e-4cea-b72c-57887c16e355"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:13.524052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-76237415-8593-413c-96ee-383e55e862bd req-cb0ee4b0-ddaa-41bc-b5d9-afda168ade3a service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:13.524499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-76237415-8593-413c-96ee-383e55e862bd req-cb0ee4b0-ddaa-41bc-b5d9-afda168ade3a service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:13.535732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-76237415-8593-413c-96ee-383e55e862bd req-cb0ee4b0-ddaa-41bc-b5d9-afda168ade3a service nova] Creating event network-vif-unplugged:97598fb5-567e-4cea-b72c-57887c16e355 for instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 on hv-cinder-79760 Jun 02 16:16:13.540705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-76237415-8593-413c-96ee-383e55e862bd req-cb0ee4b0-ddaa-41bc-b5d9-afda168ade3a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029485 Jun 02 16:16:13.541276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 480/957] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:16:14.249230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:14.249843 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:14.256990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:14.257437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:14.258249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:14.258687 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:14.395547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:14.403540 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:14.405058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:14.406296 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f334ba5f-00b2-4bb4-a9be-e6d468fccaf4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1723 microversion: 2.20 time: 0.160844 Jun 02 16:16:14.406850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 478/958] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:14 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:15.426777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:15.427607 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:15.434132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:15.434522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:15.435295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:15.435730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:15.568561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:15.576954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:15.578506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:15.579674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-47e90268-a8f9-4895-b8d8-bc4878d4a8e0 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1666 microversion: 2.20 time: 0.158564 Jun 02 16:16:15.580986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 481/959] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:15 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:15.597168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4096bd04-9d49-41a1-b643-978601f9edc7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19575860-2acf-47b4-bd26-c11e1fe5adee"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:15.598306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4096bd04-9d49-41a1-b643-978601f9edc7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:15.604665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4096bd04-9d49-41a1-b643-978601f9edc7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:15.605112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4096bd04-9d49-41a1-b643-978601f9edc7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:15.605872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4096bd04-9d49-41a1-b643-978601f9edc7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:15.606402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4096bd04-9d49-41a1-b643-978601f9edc7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:16.715603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4096bd04-9d49-41a1-b643-978601f9edc7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.122677 Jun 02 16:16:16.716263 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 479/960] 10.222.0.59 () {62 vars in 1363 bytes} [Thu Jun 2 16:16:15 2022] POST /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/os-volume_attachments => generated 188 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:16:16.829036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-aeb5dcd4-b661-41d4-9471-9c69e402eddf tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:16.829559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-aeb5dcd4-b661-41d4-9471-9c69e402eddf tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:16.837050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aeb5dcd4-b661-41d4-9471-9c69e402eddf tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:16.837504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aeb5dcd4-b661-41d4-9471-9c69e402eddf tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:16.838306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aeb5dcd4-b661-41d4-9471-9c69e402eddf tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:16.838740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aeb5dcd4-b661-41d4-9471-9c69e402eddf tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:17.389478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-aeb5dcd4-b661-41d4-9471-9c69e402eddf tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "DELETE /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/os-volume_attachments/19575860-2acf-47b4-bd26-c11e1fe5adee" status: 202 len: 0 microversion: 2.20 time: 0.564267 Jun 02 16:16:17.390222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 482/961] 10.222.0.59 () {60 vars in 1456 bytes} [Thu Jun 2 16:16:16 2022] DELETE /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/os-volume_attachments/19575860-2acf-47b4-bd26-c11e1fe5adee => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:16:17.449494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-35f30991-d3de-42c8-8230-6e0a849a85ca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:17.450518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-35f30991-d3de-42c8-8230-6e0a849a85ca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:17.457368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-35f30991-d3de-42c8-8230-6e0a849a85ca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:17.457824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-35f30991-d3de-42c8-8230-6e0a849a85ca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:17.458652 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-35f30991-d3de-42c8-8230-6e0a849a85ca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:17.459095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-35f30991-d3de-42c8-8230-6e0a849a85ca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:17.690002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-35f30991-d3de-42c8-8230-6e0a849a85ca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "POST /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/action" status: 202 len: 0 microversion: 2.20 time: 0.244126 Jun 02 16:16:17.691407 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 480/962] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jun 2 16:16:17 2022] POST /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:16:17.701102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:17.702385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:17.710575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:17.710575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:17.711300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:17.711745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:17.735033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2caf73d5-65b1-44ad-817f-9ff5b603a599 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:17.736274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2caf73d5-65b1-44ad-817f-9ff5b603a599 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:17.743107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2caf73d5-65b1-44ad-817f-9ff5b603a599 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:17.744968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2caf73d5-65b1-44ad-817f-9ff5b603a599 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:17.744968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2caf73d5-65b1-44ad-817f-9ff5b603a599 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:17.744968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2caf73d5-65b1-44ad-817f-9ff5b603a599 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:17.784940 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2caf73d5-65b1-44ad-817f-9ff5b603a599 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053685 Jun 02 16:16:17.787774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 481/963] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:16:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:16:17.796712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d782a4e3-33f8-43b6-b88e-6bdcc50a62e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:17.797243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d782a4e3-33f8-43b6-b88e-6bdcc50a62e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:17.808983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d782a4e3-33f8-43b6-b88e-6bdcc50a62e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:17.810018 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d782a4e3-33f8-43b6-b88e-6bdcc50a62e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:17.811065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d782a4e3-33f8-43b6-b88e-6bdcc50a62e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:17.812025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d782a4e3-33f8-43b6-b88e-6bdcc50a62e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:17.854453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d782a4e3-33f8-43b6-b88e-6bdcc50a62e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/f70d3698-4cd7-4c4b-b65f-fba28159611c" status: 200 len: 194 microversion: 2.1 time: 0.061600 Jun 02 16:16:17.856177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 482/964] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Jun 2 16:16:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/f70d3698-4cd7-4c4b-b65f-fba28159611c => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:16:17.877884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:17.887175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:17.888664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:17.889978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-42837417-4f97-48d9-a6c2-9bae99bc5a83 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1674 microversion: 2.20 time: 0.194546 Jun 02 16:16:17.899147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 483/965] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:17 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:18.313572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4e27d969-f4f9-4093-a16d-d9dd095e43fa tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:18.314090 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4e27d969-f4f9-4093-a16d-d9dd095e43fa tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:18.317403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-0ba8202e-720f-4c6f-a36c-d352abcdfb90 req-28b093e7-a617-4205-ac68-893b5b4ea7cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07acc928-a366-4e20-8462-b4e78a2a4e0b", "tag": "3b9de9f4-4fd1-4131-9b1c-81b197b00a5f"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:18.321618 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e27d969-f4f9-4093-a16d-d9dd095e43fa tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:18.322091 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e27d969-f4f9-4093-a16d-d9dd095e43fa tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:18.325325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e27d969-f4f9-4093-a16d-d9dd095e43fa tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:18.325789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e27d969-f4f9-4093-a16d-d9dd095e43fa tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:18.326699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-0ba8202e-720f-4c6f-a36c-d352abcdfb90 req-28b093e7-a617-4205-ac68-893b5b4ea7cf service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:18.327369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-0ba8202e-720f-4c6f-a36c-d352abcdfb90 req-28b093e7-a617-4205-ac68-893b5b4ea7cf service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:18.342427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-0ba8202e-720f-4c6f-a36c-d352abcdfb90 req-28b093e7-a617-4205-ac68-893b5b4ea7cf service nova] Creating event network-changed:3b9de9f4-4fd1-4131-9b1c-81b197b00a5f for instance 07acc928-a366-4e20-8462-b4e78a2a4e0b on hv-cinder-79760 Jun 02 16:16:18.349334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-0ba8202e-720f-4c6f-a36c-d352abcdfb90 req-28b093e7-a617-4205-ac68-893b5b4ea7cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036278 Jun 02 16:16:18.351499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 484/966] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:16:18.382737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4e27d969-f4f9-4093-a16d-d9dd095e43fa tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Going to try to terminate instance {{(pid=118257) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:16:18.382737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:18.785713 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4e27d969-f4f9-4093-a16d-d9dd095e43fa tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "DELETE /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 204 len: 0 microversion: 2.1 time: 0.475605 Jun 02 16:16:18.786571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 483/967] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:16:18 2022] DELETE /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:16:18.795386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-77ebdcd9-5eac-4eef-aab3-9fc1d3913a24 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:18.796090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-77ebdcd9-5eac-4eef-aab3-9fc1d3913a24 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:18.802817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77ebdcd9-5eac-4eef-aab3-9fc1d3913a24 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:18.803260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77ebdcd9-5eac-4eef-aab3-9fc1d3913a24 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:18.804032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77ebdcd9-5eac-4eef-aab3-9fc1d3913a24 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:18.804687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77ebdcd9-5eac-4eef-aab3-9fc1d3913a24 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:18.916470 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:18.917262 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:18.924136 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:18.924764 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:18.925774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:18.926457 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:19.034170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-77ebdcd9-5eac-4eef-aab3-9fc1d3913a24 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:19.038362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-77ebdcd9-5eac-4eef-aab3-9fc1d3913a24 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.247198 Jun 02 16:16:19.039088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 485/968] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:18 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:19.069724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:19.077747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:19.079343 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:19.081121 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cdacf6bf-d9bf-4914-ad51-0d7d4a8eb46e tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1674 microversion: 2.20 time: 0.169154 Jun 02 16:16:19.081685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 484/969] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:18 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:20.055689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5397798e-cbb3-48c5-9e6d-6ad8b8bd2ec2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:20.056296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5397798e-cbb3-48c5-9e6d-6ad8b8bd2ec2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:20.062789 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5397798e-cbb3-48c5-9e6d-6ad8b8bd2ec2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:20.063228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5397798e-cbb3-48c5-9e6d-6ad8b8bd2ec2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:20.063980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5397798e-cbb3-48c5-9e6d-6ad8b8bd2ec2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:20.065743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5397798e-cbb3-48c5-9e6d-6ad8b8bd2ec2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:20.099283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:20.099888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:20.106310 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:20.106753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:20.107518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:20.107968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:20.248774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:20.252306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5397798e-cbb3-48c5-9e6d-6ad8b8bd2ec2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:20.255026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:20.261921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5397798e-cbb3-48c5-9e6d-6ad8b8bd2ec2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1569 microversion: 2.1 time: 0.210024 Jun 02 16:16:20.262208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:20.262540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 486/970] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:20 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:20.273589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:20.277290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ebaea34c-b0b2-4228-8281-3b5da98960c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1674 microversion: 2.20 time: 0.179686 Jun 02 16:16:20.277290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 485/971] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:20 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:20.590489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5d0d8ba6-b072-4243-952d-ea23f2bf12d9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c8a390b-7550-4677-8e46-a5339d2dc391"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:20.591708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5d0d8ba6-b072-4243-952d-ea23f2bf12d9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:20.599094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d0d8ba6-b072-4243-952d-ea23f2bf12d9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:20.599551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d0d8ba6-b072-4243-952d-ea23f2bf12d9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:20.600323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d0d8ba6-b072-4243-952d-ea23f2bf12d9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:20.602291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d0d8ba6-b072-4243-952d-ea23f2bf12d9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:21.280053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cdedf3c7-08cf-4655-87f4-67ad4a26d022 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:21.280673 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cdedf3c7-08cf-4655-87f4-67ad4a26d022 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:21.288300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdedf3c7-08cf-4655-87f4-67ad4a26d022 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:21.288922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdedf3c7-08cf-4655-87f4-67ad4a26d022 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:21.289803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdedf3c7-08cf-4655-87f4-67ad4a26d022 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:21.290608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cdedf3c7-08cf-4655-87f4-67ad4a26d022 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:21.431463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cdedf3c7-08cf-4655-87f4-67ad4a26d022 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:21.439060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cdedf3c7-08cf-4655-87f4-67ad4a26d022 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1450 microversion: 2.1 time: 0.162886 Jun 02 16:16:21.439623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 486/972] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:21 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:21.444400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:21.445031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:21.450864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:21.459517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:21.459517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:21.459517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:21.640727 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:21.649691 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:21.651254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:21.652411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6f2c5ae9-2173-4b7f-90a1-2a8e55fd6da4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.211764 Jun 02 16:16:21.652972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 487/973] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:21 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:21.657423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-6a5057cb-c0f7-4433-88b1-2bc14ddd7667 req-b40f38a7-1d0e-4e14-bc18-34cc727f6e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07acc928-a366-4e20-8462-b4e78a2a4e0b", "name": "network-vif-deleted", "tag": "3b9de9f4-4fd1-4131-9b1c-81b197b00a5f"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:21.666088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-6a5057cb-c0f7-4433-88b1-2bc14ddd7667 req-b40f38a7-1d0e-4e14-bc18-34cc727f6e2f service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:21.666637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-6a5057cb-c0f7-4433-88b1-2bc14ddd7667 req-b40f38a7-1d0e-4e14-bc18-34cc727f6e2f service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:21.677500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-6a5057cb-c0f7-4433-88b1-2bc14ddd7667 req-b40f38a7-1d0e-4e14-bc18-34cc727f6e2f service nova] Creating event network-vif-deleted:3b9de9f4-4fd1-4131-9b1c-81b197b00a5f for instance 07acc928-a366-4e20-8462-b4e78a2a4e0b on hv-cinder-79760 Jun 02 16:16:21.682698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-6a5057cb-c0f7-4433-88b1-2bc14ddd7667 req-b40f38a7-1d0e-4e14-bc18-34cc727f6e2f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028602 Jun 02 16:16:21.683563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 488/974] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:16:21.726729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5d0d8ba6-b072-4243-952d-ea23f2bf12d9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.140602 Jun 02 16:16:21.727759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 487/975] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:16:20 2022] POST /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 194 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:16:22.456777 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cf97a07a-5e00-424a-9ee4-eea6e24909c3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:22.457468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cf97a07a-5e00-424a-9ee4-eea6e24909c3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:22.464223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf97a07a-5e00-424a-9ee4-eea6e24909c3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:22.464664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf97a07a-5e00-424a-9ee4-eea6e24909c3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:22.465422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf97a07a-5e00-424a-9ee4-eea6e24909c3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:22.465851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf97a07a-5e00-424a-9ee4-eea6e24909c3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:22.531636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cf97a07a-5e00-424a-9ee4-eea6e24909c3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:22.539763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cf97a07a-5e00-424a-9ee4-eea6e24909c3 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1219 microversion: 2.1 time: 0.087241 Jun 02 16:16:22.540331 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 489/976] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:22 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:22.675359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:22.676061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:22.682759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:22.683243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:22.684177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:22.684478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:22.833277 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:22.844943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:22.847645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:22.848817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f5961931-67ed-4594-a356-f5529b7779a3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.178993 Jun 02 16:16:22.849357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 488/977] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:22 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:23.556463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:23.557248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:23.564151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:23.564655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:23.565677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:23.566143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:23.602125 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:23.602568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:23.603023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:23.644243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:23.652285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-10bee5ed-0ea8-48f2-9411-be54fa2b6952 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.099894 Jun 02 16:16:23.653027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 490/978] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:23 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:23.867937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:23.869093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:23.875623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:23.876073 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:23.877211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:23.877661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:24.021666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:24.029755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:24.031324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:24.032494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-27207dff-6d27-42b5-8aa0-6c3bf848a820 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.169283 Jun 02 16:16:24.033054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 489/979] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:23 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:24.670497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:24.671108 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:24.678367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:24.678816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:24.679590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:24.680026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:24.713274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:24.713883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:24.714459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:24.760353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:24.768352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-796524eb-8445-40e2-becf-671c8444e25c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.101604 Jun 02 16:16:24.769531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 491/980] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:24 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:25.052261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:25.052933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:25.059547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:25.060080 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:25.060926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:25.061454 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:25.200736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:25.210035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:25.211568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:25.212742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-22f093c1-9f7c-4936-8c97-407ae0388eb7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.165314 Jun 02 16:16:25.213522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 490/981] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:25 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:25.785948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:25.786740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:25.800481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:25.800932 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:25.801920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:25.802215 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:25.843720 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:25.844162 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:25.844618 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:25.887042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:25.895965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4199f865-ab8b-48bc-bdaf-836d5919f26c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.114310 Jun 02 16:16:25.896732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 492/982] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:25 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:26.232266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:26.233622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:26.241663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:26.242237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:26.243093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:26.243851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:26.382171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:26.390097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:26.391626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:26.392897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d5349c53-a322-4f68-bd42-c26036d675f4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.164650 Jun 02 16:16:26.393987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 491/983] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:26 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:26.913092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:26.913816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:26.922317 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:26.923087 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:26.923901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:26.924918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:26.972565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:26.973431 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:26.974019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:27.025242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:27.035581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-02e8c5a2-f659-440d-8cf5-f56b43317032 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.126311 Jun 02 16:16:27.036830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 493/984] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:26 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:27.412851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:27.414257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:27.421228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:27.421960 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:27.422975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:27.423469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:27.570755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:27.579306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:27.581690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:27.583031 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6fcbde02-b47f-4730-b6b1-a07447bdb9e2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.174894 Jun 02 16:16:27.583528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 492/985] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:27 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:28.053358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:28.053961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:28.060700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:28.061147 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:28.061910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:28.062367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:28.096278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:28.096722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:28.097166 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:28.265996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:28.275744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0bd95511-54a2-49d4-8ced-dace08742cf2 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.226629 Jun 02 16:16:28.276546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 494/986] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:28 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:28.603152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:28.603781 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:28.613360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:28.613880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:28.614623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:28.615249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:28.827087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:28.836509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:28.838013 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:28.839345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6420e66b-b72e-4c8d-b157-06c23be013ae tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.240429 Jun 02 16:16:28.839913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 493/987] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:28 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:29.011033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e60f1c46-7ea9-4a94-9ed6-2dc41f3ec3d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82d67b29-e2bc-4537-86f3-ebba9d154c91", "device": "/dev/sdb"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:29.015481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e60f1c46-7ea9-4a94-9ed6-2dc41f3ec3d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:29.020312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e60f1c46-7ea9-4a94-9ed6-2dc41f3ec3d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:29.020852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e60f1c46-7ea9-4a94-9ed6-2dc41f3ec3d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:29.021888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e60f1c46-7ea9-4a94-9ed6-2dc41f3ec3d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:29.022378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e60f1c46-7ea9-4a94-9ed6-2dc41f3ec3d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:29.292836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:29.293446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:29.299798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:29.300344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:29.301112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:29.301550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:29.334611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:29.334981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:29.335431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:29.378296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:29.385893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-793116f6-b1db-4f3d-b6b1-2af3ae1e7eed tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.096944 Jun 02 16:16:29.386496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 494/988] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:29 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:29.858160 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:29.858934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:29.865270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:29.865719 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:29.866518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:29.866981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:30.011038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:30.019958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:30.021455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:30.022667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d17258eb-a7d1-45cd-b69e-abe775ccb72a tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.168505 Jun 02 16:16:30.023236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 495/989] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:29 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:30.403066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:30.403878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:30.410352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:30.411560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:30.411560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:30.412001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:30.446809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:30.447487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:30.448099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:30.493973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:30.501549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3b35b5c7-c65e-4710-a407-0907d79158fe tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.102454 Jun 02 16:16:30.502229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 496/990] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:30 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:31.041107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:31.041903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:31.048384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:31.048924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:31.050827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:31.051339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:31.191234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:31.199478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:31.200958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:31.202139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7672a05a-28c8-41c0-80ff-692a2a1af749 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.165032 Jun 02 16:16:31.202683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 497/991] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:31 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:31.519794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:31.520409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:31.527556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:31.528018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:31.528812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:31.529301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:31.563926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:31.564978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:31.566126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:31.607811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:31.616597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9af1d0ea-2071-4491-b494-85d956b0c232 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.101365 Jun 02 16:16:31.617181 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 498/992] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:31 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:32.222384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:32.224238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:32.229949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:32.230434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:32.231193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:32.231620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:32.379311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:32.387407 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:32.388918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:32.390088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2d63d286-aa6d-4d54-b468-402debded6b2 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.173288 Jun 02 16:16:32.390669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 499/993] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:32 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:32.634019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:32.634666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:32.640654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:32.641103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:32.641871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:32.642333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:32.672706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:32.673167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:32.673590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:32.714680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:32.716913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:32.723484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-47a01c16-cf70-4a38-8e56-bcaf04dca3e0 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.093369 Jun 02 16:16:32.724044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 500/994] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:32 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:33.409603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:33.410333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:33.417353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:33.417799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:33.418627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:33.419057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:33.551098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:33.559019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:33.560505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:33.561648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9b94ca9d-805e-4b3b-b557-f40647b677c7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.156787 Jun 02 16:16:33.562219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 501/995] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:33 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:33.740526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:33.741079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:33.746973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:33.747415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:33.748167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:33.748595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:33.778229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:33.778673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:33.779108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:33.822568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:33.829787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-31e904f4-c2ab-4d5a-a36b-513031a03a10 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.093393 Jun 02 16:16:33.831015 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 502/996] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:33 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:34.580101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:34.580781 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:34.587289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:34.587739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:34.588498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:34.588934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:34.722408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:34.730251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:34.731764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:34.732961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-160691ef-d98d-4cf0-8d3f-b04102f34bb6 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.156823 Jun 02 16:16:34.733519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 503/997] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:34 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:34.847603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:34.848226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:34.854040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:34.854515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:34.855272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:34.855702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:34.885312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:34.885748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:34.886230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:34.927266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:34.934678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-76f17d1b-f6a9-48bd-88ad-882c47085fec tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.091506 Jun 02 16:16:34.935236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 504/998] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:34 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:35.752416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:35.753057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:35.759463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:35.759908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:35.760703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:35.761133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:35.891680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:35.900002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:35.901484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:35.902668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-30f8620a-4850-4391-9e37-5c2fbb4fb1a7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.154401 Jun 02 16:16:35.903218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 505/999] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:35 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:35.952478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:35.953097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:35.959863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:35.960314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:35.961113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:35.961582 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:35.991842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:35.992294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:35.992742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:36.032352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:36.040272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f0a14108-3f92-4790-8b5e-98e128c71fe1 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.092175 Jun 02 16:16:36.040829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 506/1000] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:35 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:36.921223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:36.921854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:36.929085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:36.929534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:36.930322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:36.930763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:37.058662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:37.066543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:37.068016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:37.069161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2c47f8c9-0080-4a38-bfde-850c0ad717f7 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.152053 Jun 02 16:16:37.069713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 507/1001] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:36 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:37.073945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:37.074579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:37.080192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:37.080643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:37.081395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:37.081826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:37.111963 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:37.112401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:37.112843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:37.155126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:37.163478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1a3e0ab1-1641-4b31-82aa-187b048c69b9 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.092827 Jun 02 16:16:37.164033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 508/1002] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:37 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:38.087027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:38.087672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:38.094032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:38.094508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:38.095260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:38.096117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:38.226511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:38.233064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:38.234570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:38.235712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0bf97d4e-399b-4023-ac53-26e104c654d9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.152633 Jun 02 16:16:38.236772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 509/1003] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:38 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:38.241145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:38.242062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:38.247378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:38.247821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:38.248573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:38.249004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:38.278915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:38.279364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:38.279846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:38.321308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:38.328763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-20032991-e5a8-467e-a59b-e10161395d92 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.091044 Jun 02 16:16:38.329320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 510/1004] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:38 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:39.016355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:39.099521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:39.254899 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:39.255506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:39.257872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=86 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:39.263220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:39.263673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:39.264440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:39.264872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:39.396085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:39.404101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:39.405647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:39.406877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8d7d0b59-65ad-41eb-9a59-91db69f8cefd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.156806 Jun 02 16:16:39.407442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 511/1005] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:39 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:39.411980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:39.412601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:39.418419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:39.418875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:39.419645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:39.420083 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:39.450576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:39.451026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:39.451474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lazy-loading 'fault' on Instance uuid 07acc928-a366-4e20-8462-b4e78a2a4e0b {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:39.491205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f09d7a733fa43a7a45f56176c752447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7bcb5f489f4a2db902c2035d9879a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:39.498594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5d6e165f-5b99-4f43-a353-8090260d3c13 tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 200 len: 1224 microversion: 2.1 time: 0.090158 Jun 02 16:16:39.499164 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 512/1006] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:39 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:40.063199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:16:40.063768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:16:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments (ip 10.222.0.59) !!! Jun 02 16:16:40.166866 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e60f1c46-7ea9-4a94-9ed6-2dc41f3ec3d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "POST /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.159599 Jun 02 16:16:40.167849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 495/1007] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:16:29 2022] POST /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments => generated 194 bytes in 11162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:16:40.424852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:40.425500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:40.431957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:40.432411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:40.433195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:40.433625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:40.516277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:40.516979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] [instance: 07acc928-a366-4e20-8462-b4e78a2a4e0b] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:40.523944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:40.524394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:40.525168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:40.525603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:40.542341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] HTTP exception thrown: Instance 07acc928-a366-4e20-8462-b4e78a2a4e0b could not be found. Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Request method failure captured: Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b HTTP/1.1 Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimODdxHph82Mq38hERvNORRcCLjvEtztfYAr2BMXSjgIS0_Wck3yx5yDHIOiUVBFOI3JKzg8c1FxEyGz6sDLIGO7no0F9bCUT3FHdnnxHjKCybZA4-CnKExtVLdBt1kxnqh7jcvk5H6grHj7wKgGIjbkFptQ4yimor8hyfNQQxF_IzKE Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: aa7bcb5f489f4a2db902c2035d9879a5 Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-TestShelveInstance-489418938 Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:16:40.543991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_aa7bcb5f489f4a2db902c2035d9879a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aa7bcb5f489f4a2db902c2035d9879a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/aa7bcb5f489f4a2db902c2035d9879a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aa7bcb5f489f4a2db902c2035d9879a5"}]}] Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-TestShelveInstance-489418938 Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: aa7bcb5f489f4a2db902c2035d9879a5 Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-TestShelveInstance-489418938 Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-TestShelveInstance-489418938-project Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 2f09d7a733fa43a7a45f56176c752447 Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-TestShelveInstance-489418938-project Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 07acc928-a366-4e20-8462-b4e78a2a4e0b could not be found. Jun 02 16:16:40.545494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '07acc928-a366-4e20-8462-b4e78a2a4e0b'} Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07acc928-a366-4e20-8462-b4e78a2a4e0b could not be found. Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:16:40.546518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07acc928-a366-4e20-8462-b4e78a2a4e0b could not be found. Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07acc928-a366-4e20-8462-b4e78a2a4e0b could not be found. Jun 02 16:16:40.548172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:16:40.549549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Returning 404 to user: Instance 07acc928-a366-4e20-8462-b4e78a2a4e0b could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:16:40.549549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-96fbcb5e-f317-4ccc-8059-fc86679b571c tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b" status: 404 len: 111 microversion: 2.1 time: 0.033531 Jun 02 16:16:40.549549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 496/1008] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:40 2022] GET /compute/v2.1/servers/07acc928-a366-4e20-8462-b4e78a2a4e0b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 16:16:40.567517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:40.575725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:40.577211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:40.578397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2790f9f7-5bba-4483-ae0b-36c1920c8d39 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.157522 Jun 02 16:16:40.578957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 513/1009] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:40 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:40.800170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8fdbc96f-f9f2-40c3-addd-8931764a470e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] Calling method '.version_select at 0x7f2d5c598ee0>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:40.911608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8fdbc96f-f9f2-40c3-addd-8931764a470e tempest-TestShelveInstance-489418938 tempest-TestShelveInstance-489418938-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2029801029" status: 202 len: 0 microversion: 2.1 time: 0.115373 Jun 02 16:16:40.912576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 497/1010] 10.222.0.59 () {58 vars in 1253 bytes} [Thu Jun 2 16:16:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2029801029 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:16:41.598690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:41.599884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:41.607657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:41.608342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:41.609271 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:41.610003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:41.827170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:41.836549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:41.838047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:41.839328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f0f4de9a-7839-451e-b8b6-a1bfe2967eeb tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.246248 Jun 02 16:16:41.849603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 514/1011] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:41 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:16:41.919876 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-11d52eb5-ff29-4dcd-b1e2-60143bd02ba5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:41.920785 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-11d52eb5-ff29-4dcd-b1e2-60143bd02ba5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:41.928972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11d52eb5-ff29-4dcd-b1e2-60143bd02ba5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:41.929433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11d52eb5-ff29-4dcd-b1e2-60143bd02ba5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:41.930239 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11d52eb5-ff29-4dcd-b1e2-60143bd02ba5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:41.930678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11d52eb5-ff29-4dcd-b1e2-60143bd02ba5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:41.963939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-11d52eb5-ff29-4dcd-b1e2-60143bd02ba5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048428 Jun 02 16:16:41.964532 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 498/1012] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:16:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:16:42.106803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cce681a2-fe53-45f8-82b9-b099a7d9770f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:42.107248 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cce681a2-fe53-45f8-82b9-b099a7d9770f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:42.114411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cce681a2-fe53-45f8-82b9-b099a7d9770f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:42.114867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cce681a2-fe53-45f8-82b9-b099a7d9770f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:42.115656 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cce681a2-fe53-45f8-82b9-b099a7d9770f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:42.116095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cce681a2-fe53-45f8-82b9-b099a7d9770f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:42.132069 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:42.149810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cce681a2-fe53-45f8-82b9-b099a7d9770f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/f70d3698-4cd7-4c4b-b65f-fba28159611c" status: 200 len: 194 microversion: 2.1 time: 0.047209 Jun 02 16:16:42.155445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 515/1013] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Jun 2 16:16:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/f70d3698-4cd7-4c4b-b65f-fba28159611c => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:16:42.161785 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-356bc0c1-16dd-49bb-a7eb-4c9faf4a41b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:42.162326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-356bc0c1-16dd-49bb-a7eb-4c9faf4a41b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:42.190668 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-356bc0c1-16dd-49bb-a7eb-4c9faf4a41b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:42.191439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-356bc0c1-16dd-49bb-a7eb-4c9faf4a41b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:42.192460 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-356bc0c1-16dd-49bb-a7eb-4c9faf4a41b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:42.192906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-356bc0c1-16dd-49bb-a7eb-4c9faf4a41b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:42.293663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-356bc0c1-16dd-49bb-a7eb-4c9faf4a41b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lazy-loading 'services' on Instance uuid a4d978fa-9abe-42e1-af29-1ccea22ff4c9 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:42.538852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-356bc0c1-16dd-49bb-a7eb-4c9faf4a41b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/f70d3698-4cd7-4c4b-b65f-fba28159611c" status: 202 len: 0 microversion: 2.1 time: 0.382031 Jun 02 16:16:42.539632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 499/1014] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:16:42 2022] DELETE /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/f70d3698-4cd7-4c4b-b65f-fba28159611c => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:16:42.868728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:42.869335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:42.876221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:42.876665 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:42.877428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:42.878441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:43.013326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:43.022231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:43.023764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:43.025196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-76278f1e-3736-4541-8265-a0157373bf22 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.160393 Jun 02 16:16:43.026133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 516/1015] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:42 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:43.651337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-9e725a69-53c3-41dc-a646-c4523990158c req-5a7976ec-35ff-446e-a076-edebd4b75a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942de225-4aff-4a9e-85f0-634ab0ac44e3", "name": "network-vif-plugged", "status": "completed", "tag": "97598fb5-567e-4cea-b72c-57887c16e355"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:16:43.670697 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-9e725a69-53c3-41dc-a646-c4523990158c req-5a7976ec-35ff-446e-a076-edebd4b75a59 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:43.670697 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-9e725a69-53c3-41dc-a646-c4523990158c req-5a7976ec-35ff-446e-a076-edebd4b75a59 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:43.674346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-9e725a69-53c3-41dc-a646-c4523990158c req-5a7976ec-35ff-446e-a076-edebd4b75a59 service nova] Creating event network-vif-plugged:97598fb5-567e-4cea-b72c-57887c16e355 for instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 on hv-cinder-79760 Jun 02 16:16:43.680442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-9e725a69-53c3-41dc-a646-c4523990158c req-5a7976ec-35ff-446e-a076-edebd4b75a59 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034889 Jun 02 16:16:43.681034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 500/1016] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:16:44.042893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:44.043612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:44.050425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:44.051176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:44.052024 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:44.052655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:44.239125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:44.247120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:44.248607 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:44.249755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-14b7e3ae-c2f5-49bc-b9d2-365f9620777b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.210856 Jun 02 16:16:44.250417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 517/1017] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:44 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:45.271068 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:45.271853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:45.278166 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:45.278661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:45.279436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:45.279878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:45.509423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:45.517608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:45.519564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:45.520739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-858734cb-95db-4e6c-86e8-edbc2294c5f3 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.255772 Jun 02 16:16:45.521299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 501/1018] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:45 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:46.539129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:46.539738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:46.547058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:46.547515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:46.548451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:46.548899 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:46.695687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:46.704378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:46.706824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:46.710866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2fb8f6b1-c994-433b-9efc-1906d2978cb4 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1732 microversion: 2.20 time: 0.172616 Jun 02 16:16:46.710866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 518/1019] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:46 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:47.726705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:47.727426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:47.733918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:47.734499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:47.735456 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:47.736207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:47.893428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:47.901893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:47.903491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:47.904796 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f8d023a4-5289-4357-aaa2-46e5ba3c0cca tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1719 microversion: 2.20 time: 0.183514 Jun 02 16:16:47.906098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 502/1020] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:16:47 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:16:50.135548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0e63a535-be6b-4cbc-8b20-391c8d085d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:50.136302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0e63a535-be6b-4cbc-8b20-391c8d085d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:50.142947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e63a535-be6b-4cbc-8b20-391c8d085d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:50.143516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e63a535-be6b-4cbc-8b20-391c8d085d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:50.144284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e63a535-be6b-4cbc-8b20-391c8d085d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:50.144717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e63a535-be6b-4cbc-8b20-391c8d085d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:50.174227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0e63a535-be6b-4cbc-8b20-391c8d085d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/6c8a390b-7550-4677-8e46-a5339d2dc391" status: 200 len: 194 microversion: 2.1 time: 0.042601 Jun 02 16:16:50.175362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 519/1021] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Jun 2 16:16:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/6c8a390b-7550-4677-8e46-a5339d2dc391 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:16:50.185542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-846e0890-c5d6-46b2-af15-e506b038c9af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:50.186618 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-846e0890-c5d6-46b2-af15-e506b038c9af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:50.194724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-846e0890-c5d6-46b2-af15-e506b038c9af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:50.195269 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-846e0890-c5d6-46b2-af15-e506b038c9af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:50.196112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-846e0890-c5d6-46b2-af15-e506b038c9af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:50.196737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-846e0890-c5d6-46b2-af15-e506b038c9af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:50.290644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-846e0890-c5d6-46b2-af15-e506b038c9af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lazy-loading 'services' on Instance uuid a4d978fa-9abe-42e1-af29-1ccea22ff4c9 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:16:50.492079 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-846e0890-c5d6-46b2-af15-e506b038c9af tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/6c8a390b-7550-4677-8e46-a5339d2dc391" status: 202 len: 0 microversion: 2.1 time: 0.310451 Jun 02 16:16:50.492881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 503/1022] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:16:50 2022] DELETE /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments/6c8a390b-7550-4677-8e46-a5339d2dc391 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:16:53.468338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-83a99a2d-7295-4c69-aedd-6e8e95619992 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:53.468856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-83a99a2d-7295-4c69-aedd-6e8e95619992 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:53.476986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83a99a2d-7295-4c69-aedd-6e8e95619992 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:53.477445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83a99a2d-7295-4c69-aedd-6e8e95619992 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:53.478257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83a99a2d-7295-4c69-aedd-6e8e95619992 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:53.478732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83a99a2d-7295-4c69-aedd-6e8e95619992 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:53.504266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-83a99a2d-7295-4c69-aedd-6e8e95619992 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:16:53.749486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-83a99a2d-7295-4c69-aedd-6e8e95619992 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "DELETE /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 204 len: 0 microversion: 2.1 time: 0.284796 Jun 02 16:16:53.749986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 520/1023] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:16:53 2022] DELETE /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:16:53.759647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ff4c0ab1-06de-4be6-85bd-e3583911dec0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:53.760456 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ff4c0ab1-06de-4be6-85bd-e3583911dec0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:53.766915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ff4c0ab1-06de-4be6-85bd-e3583911dec0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:53.767357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ff4c0ab1-06de-4be6-85bd-e3583911dec0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:53.768684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ff4c0ab1-06de-4be6-85bd-e3583911dec0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:53.769114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ff4c0ab1-06de-4be6-85bd-e3583911dec0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:53.900599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ff4c0ab1-06de-4be6-85bd-e3583911dec0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:53.908045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ff4c0ab1-06de-4be6-85bd-e3583911dec0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.153353 Jun 02 16:16:53.908657 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 504/1024] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:53 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:54.927431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2c3a08c8-b363-4032-901e-94d91afd457d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:54.928125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2c3a08c8-b363-4032-901e-94d91afd457d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:54.934963 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c3a08c8-b363-4032-901e-94d91afd457d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:54.935421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c3a08c8-b363-4032-901e-94d91afd457d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:54.936233 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c3a08c8-b363-4032-901e-94d91afd457d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:54.936702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c3a08c8-b363-4032-901e-94d91afd457d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:55.070187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2c3a08c8-b363-4032-901e-94d91afd457d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:55.077591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2c3a08c8-b363-4032-901e-94d91afd457d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.154966 Jun 02 16:16:55.078173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 521/1025] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:54 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:56.094987 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0034d371-9b8d-4b79-8a59-6f528beac45d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:56.095546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0034d371-9b8d-4b79-8a59-6f528beac45d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:56.102511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0034d371-9b8d-4b79-8a59-6f528beac45d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:56.103052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0034d371-9b8d-4b79-8a59-6f528beac45d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:56.103822 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0034d371-9b8d-4b79-8a59-6f528beac45d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:56.104329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0034d371-9b8d-4b79-8a59-6f528beac45d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:56.239254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0034d371-9b8d-4b79-8a59-6f528beac45d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:56.246735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0034d371-9b8d-4b79-8a59-6f528beac45d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.155702 Jun 02 16:16:56.247295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 505/1026] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:56 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:57.265052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1419e085-1464-44dd-91de-6081e152c112 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:57.265674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1419e085-1464-44dd-91de-6081e152c112 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:57.272575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1419e085-1464-44dd-91de-6081e152c112 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:57.273039 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1419e085-1464-44dd-91de-6081e152c112 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:57.273894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1419e085-1464-44dd-91de-6081e152c112 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:57.274359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1419e085-1464-44dd-91de-6081e152c112 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:57.409603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1419e085-1464-44dd-91de-6081e152c112 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:57.417102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1419e085-1464-44dd-91de-6081e152c112 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.155953 Jun 02 16:16:57.417670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 522/1027] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:57 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:16:58.434578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-14e88a52-7b11-49f1-b2b5-82d8cbb849c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:58.435203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-14e88a52-7b11-49f1-b2b5-82d8cbb849c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:58.443085 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14e88a52-7b11-49f1-b2b5-82d8cbb849c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:58.443728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14e88a52-7b11-49f1-b2b5-82d8cbb849c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:58.444517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14e88a52-7b11-49f1-b2b5-82d8cbb849c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:58.444964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14e88a52-7b11-49f1-b2b5-82d8cbb849c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:58.588162 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-14e88a52-7b11-49f1-b2b5-82d8cbb849c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:58.595944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-14e88a52-7b11-49f1-b2b5-82d8cbb849c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.165034 Jun 02 16:16:58.596521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 506/1028] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:58 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:16:59.615990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6725e314-1cff-47b9-8ca1-a2b807bd6ff2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:16:59.616544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6725e314-1cff-47b9-8ca1-a2b807bd6ff2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:16:59.623269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6725e314-1cff-47b9-8ca1-a2b807bd6ff2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:59.623728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6725e314-1cff-47b9-8ca1-a2b807bd6ff2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:59.624499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6725e314-1cff-47b9-8ca1-a2b807bd6ff2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:16:59.624941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6725e314-1cff-47b9-8ca1-a2b807bd6ff2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:16:59.763912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6725e314-1cff-47b9-8ca1-a2b807bd6ff2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:16:59.772058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6725e314-1cff-47b9-8ca1-a2b807bd6ff2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.160749 Jun 02 16:16:59.776921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 523/1029] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:16:59 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:00.789266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cf0d1c7f-ae6e-4a55-86e6-b4a6a3f4bf49 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:00.789827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cf0d1c7f-ae6e-4a55-86e6-b4a6a3f4bf49 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:00.796329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf0d1c7f-ae6e-4a55-86e6-b4a6a3f4bf49 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:00.796823 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf0d1c7f-ae6e-4a55-86e6-b4a6a3f4bf49 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:00.797580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf0d1c7f-ae6e-4a55-86e6-b4a6a3f4bf49 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:00.798011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf0d1c7f-ae6e-4a55-86e6-b4a6a3f4bf49 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:00.930360 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cf0d1c7f-ae6e-4a55-86e6-b4a6a3f4bf49 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:00.937927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cf0d1c7f-ae6e-4a55-86e6-b4a6a3f4bf49 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.152563 Jun 02 16:17:00.938531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 507/1030] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:00 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:01.955391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-03727d00-9f2e-49f1-9545-4404ceb815f5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:01.956314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-03727d00-9f2e-49f1-9545-4404ceb815f5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:01.962873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03727d00-9f2e-49f1-9545-4404ceb815f5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:01.963333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03727d00-9f2e-49f1-9545-4404ceb815f5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:01.964098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03727d00-9f2e-49f1-9545-4404ceb815f5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:01.964534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03727d00-9f2e-49f1-9545-4404ceb815f5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:02.096173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-03727d00-9f2e-49f1-9545-4404ceb815f5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:02.103735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-03727d00-9f2e-49f1-9545-4404ceb815f5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.152246 Jun 02 16:17:02.104289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 524/1031] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:01 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:03.121202 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cbe0a0b8-5237-4e85-95ce-ae373aabdb30 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:03.121779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cbe0a0b8-5237-4e85-95ce-ae373aabdb30 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:03.129184 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cbe0a0b8-5237-4e85-95ce-ae373aabdb30 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:03.129640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cbe0a0b8-5237-4e85-95ce-ae373aabdb30 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:03.130447 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cbe0a0b8-5237-4e85-95ce-ae373aabdb30 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:03.130893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cbe0a0b8-5237-4e85-95ce-ae373aabdb30 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:03.264954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cbe0a0b8-5237-4e85-95ce-ae373aabdb30 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:03.273075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cbe0a0b8-5237-4e85-95ce-ae373aabdb30 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.155765 Jun 02 16:17:03.273626 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 508/1032] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:03 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:04.290618 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4260409c-6f5c-48c0-8ab9-3e77de36ef9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:04.291234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4260409c-6f5c-48c0-8ab9-3e77de36ef9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:04.297837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4260409c-6f5c-48c0-8ab9-3e77de36ef9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:04.298324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4260409c-6f5c-48c0-8ab9-3e77de36ef9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:04.299092 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4260409c-6f5c-48c0-8ab9-3e77de36ef9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:04.299576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4260409c-6f5c-48c0-8ab9-3e77de36ef9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:04.430039 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4260409c-6f5c-48c0-8ab9-3e77de36ef9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:04.437739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4260409c-6f5c-48c0-8ab9-3e77de36ef9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.150981 Jun 02 16:17:04.438360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 525/1033] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:04 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:05.454968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1f586e47-f16c-48bf-a3b4-e3882984d798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:05.455493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1f586e47-f16c-48bf-a3b4-e3882984d798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:05.462061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1f586e47-f16c-48bf-a3b4-e3882984d798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:05.462533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1f586e47-f16c-48bf-a3b4-e3882984d798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:05.463289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1f586e47-f16c-48bf-a3b4-e3882984d798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:05.463722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1f586e47-f16c-48bf-a3b4-e3882984d798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:05.593959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1f586e47-f16c-48bf-a3b4-e3882984d798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:05.602370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1f586e47-f16c-48bf-a3b4-e3882984d798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.151287 Jun 02 16:17:05.602939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 509/1034] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:06.620104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dcb896b0-7cba-4c16-afe7-e920a93bcf63 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:06.620643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dcb896b0-7cba-4c16-afe7-e920a93bcf63 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:06.627121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcb896b0-7cba-4c16-afe7-e920a93bcf63 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:06.627563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcb896b0-7cba-4c16-afe7-e920a93bcf63 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:06.628313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcb896b0-7cba-4c16-afe7-e920a93bcf63 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:06.628743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcb896b0-7cba-4c16-afe7-e920a93bcf63 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:06.758931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-dcb896b0-7cba-4c16-afe7-e920a93bcf63 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:06.766573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dcb896b0-7cba-4c16-afe7-e920a93bcf63 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.150405 Jun 02 16:17:06.767138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 526/1035] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:06 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:17:07.784510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f7148962-bfc2-4099-bf60-effcf6e1885f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:07.785063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f7148962-bfc2-4099-bf60-effcf6e1885f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:07.792042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f7148962-bfc2-4099-bf60-effcf6e1885f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:07.792493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f7148962-bfc2-4099-bf60-effcf6e1885f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:07.793259 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f7148962-bfc2-4099-bf60-effcf6e1885f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:07.793694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f7148962-bfc2-4099-bf60-effcf6e1885f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:07.929833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f7148962-bfc2-4099-bf60-effcf6e1885f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:07.937336 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f7148962-bfc2-4099-bf60-effcf6e1885f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.156768 Jun 02 16:17:07.938124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 510/1036] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:07 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:08.954964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4662f5b6-1784-457c-9539-0972ac71d175 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:08.955474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4662f5b6-1784-457c-9539-0972ac71d175 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:08.962950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4662f5b6-1784-457c-9539-0972ac71d175 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:08.963433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4662f5b6-1784-457c-9539-0972ac71d175 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:08.964199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4662f5b6-1784-457c-9539-0972ac71d175 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:08.964639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4662f5b6-1784-457c-9539-0972ac71d175 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:09.104099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4662f5b6-1784-457c-9539-0972ac71d175 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:09.111538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4662f5b6-1784-457c-9539-0972ac71d175 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.160467 Jun 02 16:17:09.112102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 527/1037] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:08 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:10.128527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2ea3420f-9978-40fb-8091-c9ac31ea7e0f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:10.129140 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2ea3420f-9978-40fb-8091-c9ac31ea7e0f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:10.131635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:10.136462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ea3420f-9978-40fb-8091-c9ac31ea7e0f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:10.136915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ea3420f-9978-40fb-8091-c9ac31ea7e0f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:10.137681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ea3420f-9978-40fb-8091-c9ac31ea7e0f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:10.138139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ea3420f-9978-40fb-8091-c9ac31ea7e0f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:10.142568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:10.270059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2ea3420f-9978-40fb-8091-c9ac31ea7e0f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:10.278451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2ea3420f-9978-40fb-8091-c9ac31ea7e0f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.153707 Jun 02 16:17:10.279019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 511/1038] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:11.296340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f72994bf-b25d-41fd-aaaa-e164b21bfbfa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:11.296944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f72994bf-b25d-41fd-aaaa-e164b21bfbfa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:11.298949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:11.304308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f72994bf-b25d-41fd-aaaa-e164b21bfbfa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:11.304753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f72994bf-b25d-41fd-aaaa-e164b21bfbfa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:11.305504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f72994bf-b25d-41fd-aaaa-e164b21bfbfa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:11.305936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f72994bf-b25d-41fd-aaaa-e164b21bfbfa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:11.436468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f72994bf-b25d-41fd-aaaa-e164b21bfbfa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:11.444272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f72994bf-b25d-41fd-aaaa-e164b21bfbfa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.151992 Jun 02 16:17:11.444840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 528/1039] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:12.461592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5919cf46-aff1-4185-b067-0bceeeebb1d4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:12.462247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5919cf46-aff1-4185-b067-0bceeeebb1d4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:12.469845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5919cf46-aff1-4185-b067-0bceeeebb1d4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:12.470330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5919cf46-aff1-4185-b067-0bceeeebb1d4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:12.471357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5919cf46-aff1-4185-b067-0bceeeebb1d4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:12.471795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5919cf46-aff1-4185-b067-0bceeeebb1d4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:12.606551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5919cf46-aff1-4185-b067-0bceeeebb1d4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:12.613975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5919cf46-aff1-4185-b067-0bceeeebb1d4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.156386 Jun 02 16:17:12.615098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 512/1040] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:13.632033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6495d12b-9482-4db6-ad74-9a255f6147d8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:13.632642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6495d12b-9482-4db6-ad74-9a255f6147d8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:13.639048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6495d12b-9482-4db6-ad74-9a255f6147d8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:13.639493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6495d12b-9482-4db6-ad74-9a255f6147d8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:13.640252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6495d12b-9482-4db6-ad74-9a255f6147d8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:13.640681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6495d12b-9482-4db6-ad74-9a255f6147d8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:13.643186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:13.779040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6495d12b-9482-4db6-ad74-9a255f6147d8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:13.786505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6495d12b-9482-4db6-ad74-9a255f6147d8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.158741 Jun 02 16:17:13.787081 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 529/1041] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:13 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:14.803511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f801b6f7-bf59-4edd-82a7-19c12b018259 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:14.804130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f801b6f7-bf59-4edd-82a7-19c12b018259 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:14.811203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f801b6f7-bf59-4edd-82a7-19c12b018259 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:14.811653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f801b6f7-bf59-4edd-82a7-19c12b018259 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:14.812418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f801b6f7-bf59-4edd-82a7-19c12b018259 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:14.812857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f801b6f7-bf59-4edd-82a7-19c12b018259 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:14.944706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f801b6f7-bf59-4edd-82a7-19c12b018259 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:14.952337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f801b6f7-bf59-4edd-82a7-19c12b018259 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.152602 Jun 02 16:17:14.952909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 513/1042] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:15.969306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a24a4df0-ede0-4d54-9889-bcbbeafc341f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:15.969842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a24a4df0-ede0-4d54-9889-bcbbeafc341f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:15.976970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a24a4df0-ede0-4d54-9889-bcbbeafc341f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:15.978699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a24a4df0-ede0-4d54-9889-bcbbeafc341f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:15.979591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a24a4df0-ede0-4d54-9889-bcbbeafc341f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:15.980123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a24a4df0-ede0-4d54-9889-bcbbeafc341f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:16.114012 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a24a4df0-ede0-4d54-9889-bcbbeafc341f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:16.122289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a24a4df0-ede0-4d54-9889-bcbbeafc341f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.156948 Jun 02 16:17:16.122843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 530/1043] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:17.139655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1ec8fa0c-81fd-4b22-9800-612a0b2d73c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:17.140261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1ec8fa0c-81fd-4b22-9800-612a0b2d73c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:17.146559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ec8fa0c-81fd-4b22-9800-612a0b2d73c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:17.147005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ec8fa0c-81fd-4b22-9800-612a0b2d73c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:17.147758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ec8fa0c-81fd-4b22-9800-612a0b2d73c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:17.148192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ec8fa0c-81fd-4b22-9800-612a0b2d73c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:17.277130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1ec8fa0c-81fd-4b22-9800-612a0b2d73c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:17.284829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1ec8fa0c-81fd-4b22-9800-612a0b2d73c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.148920 Jun 02 16:17:17.285396 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 514/1044] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:17 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:18.302224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fe3ae261-4444-4516-a106-cfcfcf74ac92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:18.302923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fe3ae261-4444-4516-a106-cfcfcf74ac92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:18.309573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe3ae261-4444-4516-a106-cfcfcf74ac92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:18.310019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe3ae261-4444-4516-a106-cfcfcf74ac92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:18.310815 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe3ae261-4444-4516-a106-cfcfcf74ac92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:18.311250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe3ae261-4444-4516-a106-cfcfcf74ac92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:18.448100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fe3ae261-4444-4516-a106-cfcfcf74ac92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:18.455673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fe3ae261-4444-4516-a106-cfcfcf74ac92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.157538 Jun 02 16:17:18.456254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 531/1045] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:18 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:19.472926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-db7e5e4e-af10-421f-89b9-9fb536addc73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:19.473539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-db7e5e4e-af10-421f-89b9-9fb536addc73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:19.480603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db7e5e4e-af10-421f-89b9-9fb536addc73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:19.481052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db7e5e4e-af10-421f-89b9-9fb536addc73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:19.481818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db7e5e4e-af10-421f-89b9-9fb536addc73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:19.482286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db7e5e4e-af10-421f-89b9-9fb536addc73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:19.617589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-db7e5e4e-af10-421f-89b9-9fb536addc73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:19.625885 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-db7e5e4e-af10-421f-89b9-9fb536addc73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.157078 Jun 02 16:17:19.626479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 515/1046] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:20.642026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-08e0132a-a70e-4ea9-bb94-54f0b3221ccf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:20.642597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-08e0132a-a70e-4ea9-bb94-54f0b3221ccf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:20.649298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08e0132a-a70e-4ea9-bb94-54f0b3221ccf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:20.649741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08e0132a-a70e-4ea9-bb94-54f0b3221ccf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:20.650552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08e0132a-a70e-4ea9-bb94-54f0b3221ccf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:20.650989 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08e0132a-a70e-4ea9-bb94-54f0b3221ccf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:20.778908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-08e0132a-a70e-4ea9-bb94-54f0b3221ccf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:20.786340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-08e0132a-a70e-4ea9-bb94-54f0b3221ccf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.148200 Jun 02 16:17:20.786911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 532/1047] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:20 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:21.806695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f310cee4-08c5-410d-bb90-a3cf0410946d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:21.807327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f310cee4-08c5-410d-bb90-a3cf0410946d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:21.813749 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f310cee4-08c5-410d-bb90-a3cf0410946d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:21.814233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f310cee4-08c5-410d-bb90-a3cf0410946d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:21.814996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f310cee4-08c5-410d-bb90-a3cf0410946d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:21.815434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f310cee4-08c5-410d-bb90-a3cf0410946d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:21.945309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f310cee4-08c5-410d-bb90-a3cf0410946d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:21.953224 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f310cee4-08c5-410d-bb90-a3cf0410946d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.150588 Jun 02 16:17:21.953779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 516/1048] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:22.970629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fef81200-750b-4dc2-8467-e14e8f575b8d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:22.971392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fef81200-750b-4dc2-8467-e14e8f575b8d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:22.978689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fef81200-750b-4dc2-8467-e14e8f575b8d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:22.979146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fef81200-750b-4dc2-8467-e14e8f575b8d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:22.979919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fef81200-750b-4dc2-8467-e14e8f575b8d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:22.980360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fef81200-750b-4dc2-8467-e14e8f575b8d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:23.108563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fef81200-750b-4dc2-8467-e14e8f575b8d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:23.116214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fef81200-750b-4dc2-8467-e14e8f575b8d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.149620 Jun 02 16:17:23.116784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 533/1049] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:24.133767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e687e2e8-bc57-4cd6-9458-99a85032864a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:24.134389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e687e2e8-bc57-4cd6-9458-99a85032864a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:24.140970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e687e2e8-bc57-4cd6-9458-99a85032864a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:24.141414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e687e2e8-bc57-4cd6-9458-99a85032864a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:24.142207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e687e2e8-bc57-4cd6-9458-99a85032864a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:24.142647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e687e2e8-bc57-4cd6-9458-99a85032864a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:24.282602 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e687e2e8-bc57-4cd6-9458-99a85032864a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:24.290650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e687e2e8-bc57-4cd6-9458-99a85032864a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.160872 Jun 02 16:17:24.291212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 517/1050] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:24 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:25.308055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c930721c-e88e-43ea-8036-5cca2a7ff7fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:25.308657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c930721c-e88e-43ea-8036-5cca2a7ff7fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:25.315061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c930721c-e88e-43ea-8036-5cca2a7ff7fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:25.315504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c930721c-e88e-43ea-8036-5cca2a7ff7fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:25.316256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c930721c-e88e-43ea-8036-5cca2a7ff7fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:25.316693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c930721c-e88e-43ea-8036-5cca2a7ff7fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:25.449065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c930721c-e88e-43ea-8036-5cca2a7ff7fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:25.456570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c930721c-e88e-43ea-8036-5cca2a7ff7fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.153032 Jun 02 16:17:25.457134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 534/1051] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:25 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:26.473694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e2cd02a4-207c-4132-9d8b-05c1c1c1848a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:26.474268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e2cd02a4-207c-4132-9d8b-05c1c1c1848a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:26.481233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2cd02a4-207c-4132-9d8b-05c1c1c1848a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:26.481681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2cd02a4-207c-4132-9d8b-05c1c1c1848a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:26.482482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2cd02a4-207c-4132-9d8b-05c1c1c1848a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:26.482916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2cd02a4-207c-4132-9d8b-05c1c1c1848a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:26.611264 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e2cd02a4-207c-4132-9d8b-05c1c1c1848a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:26.619105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e2cd02a4-207c-4132-9d8b-05c1c1c1848a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.149539 Jun 02 16:17:26.619675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 518/1052] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:26 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:27.635693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8bbec4e1-151b-45ae-a3b1-e1ca1b3d98e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:27.636311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8bbec4e1-151b-45ae-a3b1-e1ca1b3d98e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:27.642919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8bbec4e1-151b-45ae-a3b1-e1ca1b3d98e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:27.643405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8bbec4e1-151b-45ae-a3b1-e1ca1b3d98e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:27.644173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8bbec4e1-151b-45ae-a3b1-e1ca1b3d98e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:27.644616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8bbec4e1-151b-45ae-a3b1-e1ca1b3d98e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:27.779391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8bbec4e1-151b-45ae-a3b1-e1ca1b3d98e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:27.786898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8bbec4e1-151b-45ae-a3b1-e1ca1b3d98e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.155305 Jun 02 16:17:27.787464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 535/1053] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:27 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:28.804891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fa9b1399-6190-43e0-8e72-c5345c3b361b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:28.805540 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fa9b1399-6190-43e0-8e72-c5345c3b361b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:28.812861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa9b1399-6190-43e0-8e72-c5345c3b361b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:28.813366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa9b1399-6190-43e0-8e72-c5345c3b361b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:28.814296 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa9b1399-6190-43e0-8e72-c5345c3b361b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:28.814739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa9b1399-6190-43e0-8e72-c5345c3b361b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:28.944846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fa9b1399-6190-43e0-8e72-c5345c3b361b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:28.953170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fa9b1399-6190-43e0-8e72-c5345c3b361b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.152253 Jun 02 16:17:28.953740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 519/1054] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:28 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:29.970443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2e6607ca-ab0b-4ff9-a398-bc0c30a9d982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:29.971302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2e6607ca-ab0b-4ff9-a398-bc0c30a9d982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:29.977863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e6607ca-ab0b-4ff9-a398-bc0c30a9d982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:29.978472 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e6607ca-ab0b-4ff9-a398-bc0c30a9d982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:29.979167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e6607ca-ab0b-4ff9-a398-bc0c30a9d982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:29.979607 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e6607ca-ab0b-4ff9-a398-bc0c30a9d982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:30.116517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2e6607ca-ab0b-4ff9-a398-bc0c30a9d982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:30.124398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2e6607ca-ab0b-4ff9-a398-bc0c30a9d982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.157981 Jun 02 16:17:30.124961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 536/1055] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:29 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:31.141432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9febd52d-72ad-4cad-86b4-4bfaebd3cf13 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:31.142031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9febd52d-72ad-4cad-86b4-4bfaebd3cf13 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:31.148542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9febd52d-72ad-4cad-86b4-4bfaebd3cf13 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:31.148990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9febd52d-72ad-4cad-86b4-4bfaebd3cf13 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:31.149760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9febd52d-72ad-4cad-86b4-4bfaebd3cf13 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:31.150865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9febd52d-72ad-4cad-86b4-4bfaebd3cf13 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:31.283748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9febd52d-72ad-4cad-86b4-4bfaebd3cf13 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:31.291758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9febd52d-72ad-4cad-86b4-4bfaebd3cf13 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.154145 Jun 02 16:17:31.292322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 520/1056] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:31 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:32.309320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8fcb894a-cf07-41a1-8c08-23173b1bc1d5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:32.309944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8fcb894a-cf07-41a1-8c08-23173b1bc1d5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:32.317386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fcb894a-cf07-41a1-8c08-23173b1bc1d5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:32.317829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fcb894a-cf07-41a1-8c08-23173b1bc1d5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:32.318611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fcb894a-cf07-41a1-8c08-23173b1bc1d5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:32.319044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fcb894a-cf07-41a1-8c08-23173b1bc1d5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:32.451391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8fcb894a-cf07-41a1-8c08-23173b1bc1d5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:32.458916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8fcb894a-cf07-41a1-8c08-23173b1bc1d5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.153651 Jun 02 16:17:32.459474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 537/1057] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:32 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:33.476833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-28121d61-76a7-4a51-87cb-b4ae89801d1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:33.477397 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-28121d61-76a7-4a51-87cb-b4ae89801d1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:33.483839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28121d61-76a7-4a51-87cb-b4ae89801d1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:33.484285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28121d61-76a7-4a51-87cb-b4ae89801d1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:33.485043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28121d61-76a7-4a51-87cb-b4ae89801d1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:33.485483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28121d61-76a7-4a51-87cb-b4ae89801d1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:33.625182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-28121d61-76a7-4a51-87cb-b4ae89801d1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:33.632659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-28121d61-76a7-4a51-87cb-b4ae89801d1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.159822 Jun 02 16:17:33.633236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 521/1058] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:33 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:34.649678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-50eb029b-8d14-4624-8722-15fcd64dda37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:34.651034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-50eb029b-8d14-4624-8722-15fcd64dda37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:34.657402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50eb029b-8d14-4624-8722-15fcd64dda37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:34.657852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50eb029b-8d14-4624-8722-15fcd64dda37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:34.658653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50eb029b-8d14-4624-8722-15fcd64dda37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:34.659088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-50eb029b-8d14-4624-8722-15fcd64dda37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:34.788784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-50eb029b-8d14-4624-8722-15fcd64dda37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:34.797172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-50eb029b-8d14-4624-8722-15fcd64dda37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.151337 Jun 02 16:17:34.797741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 538/1059] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:34 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:35.814238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ce49170c-d2bd-41a7-a023-2c45f438aa45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:35.814916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ce49170c-d2bd-41a7-a023-2c45f438aa45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:35.821441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce49170c-d2bd-41a7-a023-2c45f438aa45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:35.822461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce49170c-d2bd-41a7-a023-2c45f438aa45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:35.823249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce49170c-d2bd-41a7-a023-2c45f438aa45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:35.823677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce49170c-d2bd-41a7-a023-2c45f438aa45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:35.960369 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ce49170c-d2bd-41a7-a023-2c45f438aa45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:35.968982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ce49170c-d2bd-41a7-a023-2c45f438aa45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.158629 Jun 02 16:17:35.971238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 522/1060] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:35 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:36.986218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7ad2e389-26d9-46b2-ad5f-e0b620ba02ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:36.989290 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7ad2e389-26d9-46b2-ad5f-e0b620ba02ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:36.993204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7ad2e389-26d9-46b2-ad5f-e0b620ba02ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:36.993837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7ad2e389-26d9-46b2-ad5f-e0b620ba02ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:36.994645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7ad2e389-26d9-46b2-ad5f-e0b620ba02ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:36.995081 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7ad2e389-26d9-46b2-ad5f-e0b620ba02ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:37.134242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7ad2e389-26d9-46b2-ad5f-e0b620ba02ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:37.141775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7ad2e389-26d9-46b2-ad5f-e0b620ba02ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.159470 Jun 02 16:17:37.142379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 539/1061] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:36 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:38.158748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4e9b3b27-c91e-44db-9379-8e6436c5b999 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:38.159367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4e9b3b27-c91e-44db-9379-8e6436c5b999 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:38.165856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e9b3b27-c91e-44db-9379-8e6436c5b999 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:38.166343 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e9b3b27-c91e-44db-9379-8e6436c5b999 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:38.167117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e9b3b27-c91e-44db-9379-8e6436c5b999 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:38.167557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4e9b3b27-c91e-44db-9379-8e6436c5b999 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:38.299685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4e9b3b27-c91e-44db-9379-8e6436c5b999 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:38.307209 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4e9b3b27-c91e-44db-9379-8e6436c5b999 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.152303 Jun 02 16:17:38.307968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 523/1062] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:38 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:39.324653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e6dd4de0-42a1-42ae-ae13-c2131a9acf8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:39.325275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e6dd4de0-42a1-42ae-ae13-c2131a9acf8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:39.333075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6dd4de0-42a1-42ae-ae13-c2131a9acf8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:39.333531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6dd4de0-42a1-42ae-ae13-c2131a9acf8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:39.334342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6dd4de0-42a1-42ae-ae13-c2131a9acf8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:39.334784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6dd4de0-42a1-42ae-ae13-c2131a9acf8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:39.464098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e6dd4de0-42a1-42ae-ae13-c2131a9acf8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:39.471825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e6dd4de0-42a1-42ae-ae13-c2131a9acf8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.151060 Jun 02 16:17:39.472386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 540/1063] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:39 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:40.488736 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-32656381-f880-448c-b933-ea0b99d6f3f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:40.489351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-32656381-f880-448c-b933-ea0b99d6f3f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:40.496284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-32656381-f880-448c-b933-ea0b99d6f3f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:40.496731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-32656381-f880-448c-b933-ea0b99d6f3f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:40.497642 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-32656381-f880-448c-b933-ea0b99d6f3f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:40.498828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-32656381-f880-448c-b933-ea0b99d6f3f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:40.644743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-32656381-f880-448c-b933-ea0b99d6f3f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:40.650276 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-32656381-f880-448c-b933-ea0b99d6f3f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.165243 Jun 02 16:17:40.650849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 524/1064] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:40 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:17:41.668050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-89ac129f-4419-4b45-b362-7b1db160a963 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:41.668651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-89ac129f-4419-4b45-b362-7b1db160a963 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:41.671768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=26 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:41.676582 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89ac129f-4419-4b45-b362-7b1db160a963 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:41.677419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89ac129f-4419-4b45-b362-7b1db160a963 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:41.677872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89ac129f-4419-4b45-b362-7b1db160a963 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:41.678349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89ac129f-4419-4b45-b362-7b1db160a963 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:41.825801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-89ac129f-4419-4b45-b362-7b1db160a963 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:41.833325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-89ac129f-4419-4b45-b362-7b1db160a963 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1580 microversion: 2.1 time: 0.169175 Jun 02 16:17:41.841334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 541/1065] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:41 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1580 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:42.210796 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-1c9edbc6-883b-4a46-bccc-25ba7f249211 req-05805ee3-a4e8-4f65-b5ae-f2d73d1f0836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63dfa5a1-a050-48bc-a951-56b9093f383e", "name": "network-vif-deleted", "tag": "ecf8ce15-849d-46b2-abea-5266d22786b8"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:17:42.220264 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-1c9edbc6-883b-4a46-bccc-25ba7f249211 req-05805ee3-a4e8-4f65-b5ae-f2d73d1f0836 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:42.220713 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-1c9edbc6-883b-4a46-bccc-25ba7f249211 req-05805ee3-a4e8-4f65-b5ae-f2d73d1f0836 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:42.232854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-1c9edbc6-883b-4a46-bccc-25ba7f249211 req-05805ee3-a4e8-4f65-b5ae-f2d73d1f0836 service nova] Creating event network-vif-deleted:ecf8ce15-849d-46b2-abea-5266d22786b8 for instance 63dfa5a1-a050-48bc-a951-56b9093f383e on hv-cinder-79760 Jun 02 16:17:42.237970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-1c9edbc6-883b-4a46-bccc-25ba7f249211 req-05805ee3-a4e8-4f65-b5ae-f2d73d1f0836 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030791 Jun 02 16:17:42.238604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 525/1066] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:17:42.851159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-668d3427-e1ec-4763-83be-d7d7bb62e08b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:42.851698 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-668d3427-e1ec-4763-83be-d7d7bb62e08b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:42.858473 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-668d3427-e1ec-4763-83be-d7d7bb62e08b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:42.858931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-668d3427-e1ec-4763-83be-d7d7bb62e08b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:42.859705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-668d3427-e1ec-4763-83be-d7d7bb62e08b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:42.860145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-668d3427-e1ec-4763-83be-d7d7bb62e08b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:42.923154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-668d3427-e1ec-4763-83be-d7d7bb62e08b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:42.931040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-668d3427-e1ec-4763-83be-d7d7bb62e08b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083798 Jun 02 16:17:42.931614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 542/1067] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:42 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:43.949582 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d5d9429e-65ce-40d5-939c-bbe52d14e586 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:43.950418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d5d9429e-65ce-40d5-939c-bbe52d14e586 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:43.953139 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=30 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:43.958057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5d9429e-65ce-40d5-939c-bbe52d14e586 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:43.958535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5d9429e-65ce-40d5-939c-bbe52d14e586 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:43.959399 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5d9429e-65ce-40d5-939c-bbe52d14e586 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:43.959844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5d9429e-65ce-40d5-939c-bbe52d14e586 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:43.962426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=86 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:44.022747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d5d9429e-65ce-40d5-939c-bbe52d14e586 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:44.031149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d5d9429e-65ce-40d5-939c-bbe52d14e586 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086201 Jun 02 16:17:44.031715 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 526/1068] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:43 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:45.048054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-216be790-de33-48fb-9f11-4922d4a69f4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:45.048664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-216be790-de33-48fb-9f11-4922d4a69f4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:45.055088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-216be790-de33-48fb-9f11-4922d4a69f4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:45.055537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-216be790-de33-48fb-9f11-4922d4a69f4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:45.056302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-216be790-de33-48fb-9f11-4922d4a69f4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:45.056737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-216be790-de33-48fb-9f11-4922d4a69f4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:45.059267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:45.118204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-216be790-de33-48fb-9f11-4922d4a69f4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:45.125748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-216be790-de33-48fb-9f11-4922d4a69f4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082072 Jun 02 16:17:45.126348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 543/1069] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:45 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:46.142053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d5b39644-f58f-4093-a971-1a4ae82c9dc3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:46.142697 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d5b39644-f58f-4093-a971-1a4ae82c9dc3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:46.149124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5b39644-f58f-4093-a971-1a4ae82c9dc3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:46.149574 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5b39644-f58f-4093-a971-1a4ae82c9dc3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:46.150373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5b39644-f58f-4093-a971-1a4ae82c9dc3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:46.150811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5b39644-f58f-4093-a971-1a4ae82c9dc3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:46.212864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d5b39644-f58f-4093-a971-1a4ae82c9dc3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:46.221316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d5b39644-f58f-4093-a971-1a4ae82c9dc3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083099 Jun 02 16:17:46.221878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 527/1070] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:46 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:47.238156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-767ae4cc-f916-4e32-ba3b-fc96703c0126 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:47.238769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-767ae4cc-f916-4e32-ba3b-fc96703c0126 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:47.245259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-767ae4cc-f916-4e32-ba3b-fc96703c0126 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:47.245715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-767ae4cc-f916-4e32-ba3b-fc96703c0126 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:47.246517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-767ae4cc-f916-4e32-ba3b-fc96703c0126 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:47.246957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-767ae4cc-f916-4e32-ba3b-fc96703c0126 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:47.309840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-767ae4cc-f916-4e32-ba3b-fc96703c0126 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:47.317779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-767ae4cc-f916-4e32-ba3b-fc96703c0126 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083526 Jun 02 16:17:47.318387 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 544/1071] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:47 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:48.335195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f8f88baa-473b-48c1-b270-fe75530e4fcd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:48.335804 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f8f88baa-473b-48c1-b270-fe75530e4fcd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:48.341821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8f88baa-473b-48c1-b270-fe75530e4fcd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:48.342857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8f88baa-473b-48c1-b270-fe75530e4fcd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:48.343614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8f88baa-473b-48c1-b270-fe75530e4fcd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:48.344039 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8f88baa-473b-48c1-b270-fe75530e4fcd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:48.403699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f8f88baa-473b-48c1-b270-fe75530e4fcd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:48.412079 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f8f88baa-473b-48c1-b270-fe75530e4fcd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080902 Jun 02 16:17:48.412646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 528/1072] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:48 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:49.428994 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-38d732f7-71f6-4171-a8b2-581f4e48f64b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:49.429550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-38d732f7-71f6-4171-a8b2-581f4e48f64b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:49.436657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38d732f7-71f6-4171-a8b2-581f4e48f64b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:49.437183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38d732f7-71f6-4171-a8b2-581f4e48f64b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:49.437940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38d732f7-71f6-4171-a8b2-581f4e48f64b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:49.438398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38d732f7-71f6-4171-a8b2-581f4e48f64b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:49.502059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-38d732f7-71f6-4171-a8b2-581f4e48f64b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:49.509495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-38d732f7-71f6-4171-a8b2-581f4e48f64b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084419 Jun 02 16:17:49.510046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 545/1073] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:49 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:50.526698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c4b80c55-3595-48c4-b79a-d79e4c63600f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:50.527325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c4b80c55-3595-48c4-b79a-d79e4c63600f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:50.535406 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4b80c55-3595-48c4-b79a-d79e4c63600f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:50.535862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4b80c55-3595-48c4-b79a-d79e4c63600f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:50.536661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4b80c55-3595-48c4-b79a-d79e4c63600f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:50.537103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4b80c55-3595-48c4-b79a-d79e4c63600f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:50.606624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c4b80c55-3595-48c4-b79a-d79e4c63600f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:50.615127 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c4b80c55-3595-48c4-b79a-d79e4c63600f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.092293 Jun 02 16:17:50.615711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 529/1074] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:50 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:51.632399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0cafac6e-1ee3-4327-bbf9-8fdc2131896a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:51.632969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0cafac6e-1ee3-4327-bbf9-8fdc2131896a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:51.639540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0cafac6e-1ee3-4327-bbf9-8fdc2131896a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:51.639989 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0cafac6e-1ee3-4327-bbf9-8fdc2131896a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:51.640760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0cafac6e-1ee3-4327-bbf9-8fdc2131896a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:51.641823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0cafac6e-1ee3-4327-bbf9-8fdc2131896a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:51.711194 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0cafac6e-1ee3-4327-bbf9-8fdc2131896a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:51.718773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0cafac6e-1ee3-4327-bbf9-8fdc2131896a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.090407 Jun 02 16:17:51.719365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 546/1075] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:51 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:52.736426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-48975eab-4c03-4b51-8e39-cf8f6cd07f36 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:52.737033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-48975eab-4c03-4b51-8e39-cf8f6cd07f36 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:52.743675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48975eab-4c03-4b51-8e39-cf8f6cd07f36 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:52.744123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48975eab-4c03-4b51-8e39-cf8f6cd07f36 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:52.744875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48975eab-4c03-4b51-8e39-cf8f6cd07f36 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:52.745389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48975eab-4c03-4b51-8e39-cf8f6cd07f36 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:52.806349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-48975eab-4c03-4b51-8e39-cf8f6cd07f36 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:52.813906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-48975eab-4c03-4b51-8e39-cf8f6cd07f36 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081532 Jun 02 16:17:52.814489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 530/1076] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:52 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:53.831252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fca062c1-07f3-44f7-a445-521b9598aa4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:53.831863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fca062c1-07f3-44f7-a445-521b9598aa4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:53.838469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fca062c1-07f3-44f7-a445-521b9598aa4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:53.838934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fca062c1-07f3-44f7-a445-521b9598aa4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:53.839685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fca062c1-07f3-44f7-a445-521b9598aa4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:53.840124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fca062c1-07f3-44f7-a445-521b9598aa4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:53.902444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fca062c1-07f3-44f7-a445-521b9598aa4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:53.910444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fca062c1-07f3-44f7-a445-521b9598aa4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083556 Jun 02 16:17:53.911011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 547/1077] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:53 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:54.926807 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7755c229-b699-47ff-97ce-e7f14fbe0553 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:54.927428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7755c229-b699-47ff-97ce-e7f14fbe0553 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:54.933878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7755c229-b699-47ff-97ce-e7f14fbe0553 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:54.934359 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7755c229-b699-47ff-97ce-e7f14fbe0553 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:54.935120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7755c229-b699-47ff-97ce-e7f14fbe0553 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:54.935558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7755c229-b699-47ff-97ce-e7f14fbe0553 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:54.999314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7755c229-b699-47ff-97ce-e7f14fbe0553 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:55.007629 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7755c229-b699-47ff-97ce-e7f14fbe0553 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085240 Jun 02 16:17:55.008192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 531/1078] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:54 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:56.024224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2e7cd91f-94b7-4403-9c8e-d673d04d0c96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:56.024946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2e7cd91f-94b7-4403-9c8e-d673d04d0c96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:56.032575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e7cd91f-94b7-4403-9c8e-d673d04d0c96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:56.033042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e7cd91f-94b7-4403-9c8e-d673d04d0c96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:56.033819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e7cd91f-94b7-4403-9c8e-d673d04d0c96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:56.034305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e7cd91f-94b7-4403-9c8e-d673d04d0c96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:56.096706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2e7cd91f-94b7-4403-9c8e-d673d04d0c96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:56.104304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2e7cd91f-94b7-4403-9c8e-d673d04d0c96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084006 Jun 02 16:17:56.104868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 548/1079] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:56 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:57.122146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-05208f2b-9b57-4032-bdc8-aceacbe67a8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:57.122757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-05208f2b-9b57-4032-bdc8-aceacbe67a8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:57.130009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-05208f2b-9b57-4032-bdc8-aceacbe67a8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:57.130487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-05208f2b-9b57-4032-bdc8-aceacbe67a8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:57.131242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-05208f2b-9b57-4032-bdc8-aceacbe67a8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:57.131704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-05208f2b-9b57-4032-bdc8-aceacbe67a8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:57.192645 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-05208f2b-9b57-4032-bdc8-aceacbe67a8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:57.200156 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-05208f2b-9b57-4032-bdc8-aceacbe67a8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081850 Jun 02 16:17:57.200717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 532/1080] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:57 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:58.216837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4d59af0a-ffbd-4227-bb96-64c0027d9bb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:58.217439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4d59af0a-ffbd-4227-bb96-64c0027d9bb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:58.225443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4d59af0a-ffbd-4227-bb96-64c0027d9bb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:58.225887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4d59af0a-ffbd-4227-bb96-64c0027d9bb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:58.226680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4d59af0a-ffbd-4227-bb96-64c0027d9bb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:58.227111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4d59af0a-ffbd-4227-bb96-64c0027d9bb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:58.290034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4d59af0a-ffbd-4227-bb96-64c0027d9bb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:58.297409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4d59af0a-ffbd-4227-bb96-64c0027d9bb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084642 Jun 02 16:17:58.298591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 549/1081] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:58 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:17:59.314156 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-60f49f0f-55a4-4e03-a962-89d90b3807f9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:17:59.314765 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-60f49f0f-55a4-4e03-a962-89d90b3807f9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:17:59.321209 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60f49f0f-55a4-4e03-a962-89d90b3807f9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:59.321651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60f49f0f-55a4-4e03-a962-89d90b3807f9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:59.322438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60f49f0f-55a4-4e03-a962-89d90b3807f9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:17:59.322870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60f49f0f-55a4-4e03-a962-89d90b3807f9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:17:59.387908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-60f49f0f-55a4-4e03-a962-89d90b3807f9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:17:59.397910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-60f49f0f-55a4-4e03-a962-89d90b3807f9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087683 Jun 02 16:17:59.398716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 533/1082] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:17:59 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:00.418140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-19f6c0ab-74b0-4d46-8375-8463ffea0ecf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:00.419018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-19f6c0ab-74b0-4d46-8375-8463ffea0ecf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:00.426737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19f6c0ab-74b0-4d46-8375-8463ffea0ecf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:00.427177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19f6c0ab-74b0-4d46-8375-8463ffea0ecf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:00.427979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19f6c0ab-74b0-4d46-8375-8463ffea0ecf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:00.428418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19f6c0ab-74b0-4d46-8375-8463ffea0ecf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:00.494507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-19f6c0ab-74b0-4d46-8375-8463ffea0ecf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:00.504236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-19f6c0ab-74b0-4d46-8375-8463ffea0ecf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.090035 Jun 02 16:18:00.505043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 550/1083] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:00 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:01.521717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-52f31469-ae80-4aba-81be-58d1cb780fa4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:01.522292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-52f31469-ae80-4aba-81be-58d1cb780fa4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:01.528797 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52f31469-ae80-4aba-81be-58d1cb780fa4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:01.529235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52f31469-ae80-4aba-81be-58d1cb780fa4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:01.529993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52f31469-ae80-4aba-81be-58d1cb780fa4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:01.530465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52f31469-ae80-4aba-81be-58d1cb780fa4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:01.591643 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-52f31469-ae80-4aba-81be-58d1cb780fa4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:01.600106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-52f31469-ae80-4aba-81be-58d1cb780fa4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082443 Jun 02 16:18:01.600676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 534/1084] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:01 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:02.616701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a2b2d719-4b4c-4c1a-bce4-b200b40203eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:02.617258 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a2b2d719-4b4c-4c1a-bce4-b200b40203eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:02.623653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2b2d719-4b4c-4c1a-bce4-b200b40203eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:02.624093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2b2d719-4b4c-4c1a-bce4-b200b40203eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:02.624846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2b2d719-4b4c-4c1a-bce4-b200b40203eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:02.625299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2b2d719-4b4c-4c1a-bce4-b200b40203eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:02.685278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a2b2d719-4b4c-4c1a-bce4-b200b40203eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:02.693323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a2b2d719-4b4c-4c1a-bce4-b200b40203eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080543 Jun 02 16:18:02.693874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 551/1085] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:02 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:03.710351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-efb26e35-e55a-4f92-b353-97ce0a562957 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:03.710955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-efb26e35-e55a-4f92-b353-97ce0a562957 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:03.717353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-efb26e35-e55a-4f92-b353-97ce0a562957 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:03.717798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-efb26e35-e55a-4f92-b353-97ce0a562957 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:03.718575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-efb26e35-e55a-4f92-b353-97ce0a562957 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:03.719005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-efb26e35-e55a-4f92-b353-97ce0a562957 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:03.779733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-efb26e35-e55a-4f92-b353-97ce0a562957 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:03.787217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-efb26e35-e55a-4f92-b353-97ce0a562957 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080770 Jun 02 16:18:03.787780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 535/1086] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:03 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:04.804472 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-75b2e26a-55e6-4b4f-ae14-086297684424 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:04.805087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-75b2e26a-55e6-4b4f-ae14-086297684424 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:04.811664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75b2e26a-55e6-4b4f-ae14-086297684424 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:04.812112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75b2e26a-55e6-4b4f-ae14-086297684424 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:04.812875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75b2e26a-55e6-4b4f-ae14-086297684424 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:04.813313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75b2e26a-55e6-4b4f-ae14-086297684424 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:04.873539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-75b2e26a-55e6-4b4f-ae14-086297684424 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:04.881460 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-75b2e26a-55e6-4b4f-ae14-086297684424 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080890 Jun 02 16:18:04.882029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 552/1087] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:04 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:05.898134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-98efda78-7878-4fb2-9bdb-edd8fca3fad1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:05.898749 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-98efda78-7878-4fb2-9bdb-edd8fca3fad1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:05.905246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98efda78-7878-4fb2-9bdb-edd8fca3fad1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:05.905696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98efda78-7878-4fb2-9bdb-edd8fca3fad1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:05.906539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98efda78-7878-4fb2-9bdb-edd8fca3fad1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:05.907006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98efda78-7878-4fb2-9bdb-edd8fca3fad1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:05.968421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-98efda78-7878-4fb2-9bdb-edd8fca3fad1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:05.976590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-98efda78-7878-4fb2-9bdb-edd8fca3fad1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082268 Jun 02 16:18:05.977171 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 536/1088] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:06.994105 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-456bc2f1-bdd3-416c-a6ff-bdbe1ae4a142 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:06.994722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-456bc2f1-bdd3-416c-a6ff-bdbe1ae4a142 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:07.001656 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-456bc2f1-bdd3-416c-a6ff-bdbe1ae4a142 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:07.002149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-456bc2f1-bdd3-416c-a6ff-bdbe1ae4a142 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:07.002915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-456bc2f1-bdd3-416c-a6ff-bdbe1ae4a142 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:07.003351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-456bc2f1-bdd3-416c-a6ff-bdbe1ae4a142 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:07.068045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-456bc2f1-bdd3-416c-a6ff-bdbe1ae4a142 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:07.075499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-456bc2f1-bdd3-416c-a6ff-bdbe1ae4a142 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085269 Jun 02 16:18:07.076060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 553/1089] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:06 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:08.092944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-120acb51-d8e9-43d0-b425-534a5c322d46 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:08.093602 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-120acb51-d8e9-43d0-b425-534a5c322d46 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:08.100400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-120acb51-d8e9-43d0-b425-534a5c322d46 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:08.100901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-120acb51-d8e9-43d0-b425-534a5c322d46 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:08.101666 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-120acb51-d8e9-43d0-b425-534a5c322d46 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:08.102135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-120acb51-d8e9-43d0-b425-534a5c322d46 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:08.167170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-120acb51-d8e9-43d0-b425-534a5c322d46 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:08.175477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-120acb51-d8e9-43d0-b425-534a5c322d46 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086292 Jun 02 16:18:08.176055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 537/1090] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:08 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:09.192696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-32401aef-94a4-4ab9-be04-048b483ec7ba tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:09.193318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-32401aef-94a4-4ab9-be04-048b483ec7ba tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:09.199904 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32401aef-94a4-4ab9-be04-048b483ec7ba tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:09.200358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32401aef-94a4-4ab9-be04-048b483ec7ba tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:09.201125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32401aef-94a4-4ab9-be04-048b483ec7ba tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:09.201565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32401aef-94a4-4ab9-be04-048b483ec7ba tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:09.265656 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-32401aef-94a4-4ab9-be04-048b483ec7ba tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:09.272164 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-32401aef-94a4-4ab9-be04-048b483ec7ba tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083903 Jun 02 16:18:09.272760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 554/1091] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:09 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:10.289472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5f249501-b7ec-4e82-9d51-b1d41b299590 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:10.290138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5f249501-b7ec-4e82-9d51-b1d41b299590 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:10.296976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f249501-b7ec-4e82-9d51-b1d41b299590 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:10.297460 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f249501-b7ec-4e82-9d51-b1d41b299590 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:10.298696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f249501-b7ec-4e82-9d51-b1d41b299590 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:10.299146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f249501-b7ec-4e82-9d51-b1d41b299590 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:10.364738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5f249501-b7ec-4e82-9d51-b1d41b299590 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:10.372247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5f249501-b7ec-4e82-9d51-b1d41b299590 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086711 Jun 02 16:18:10.372824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 538/1092] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:11.389467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-335cc5f4-3b8c-4a73-8aa1-3e4adaf28165 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:11.390094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-335cc5f4-3b8c-4a73-8aa1-3e4adaf28165 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:11.398598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-335cc5f4-3b8c-4a73-8aa1-3e4adaf28165 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:11.399060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-335cc5f4-3b8c-4a73-8aa1-3e4adaf28165 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:11.399838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-335cc5f4-3b8c-4a73-8aa1-3e4adaf28165 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:11.400278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-335cc5f4-3b8c-4a73-8aa1-3e4adaf28165 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:11.461643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-335cc5f4-3b8c-4a73-8aa1-3e4adaf28165 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:11.469202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-335cc5f4-3b8c-4a73-8aa1-3e4adaf28165 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083647 Jun 02 16:18:11.470327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 555/1093] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:12.487588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1e9a001a-2dd8-4f24-b89b-b2d4a48b4f70 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:12.488171 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1e9a001a-2dd8-4f24-b89b-b2d4a48b4f70 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:12.494773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e9a001a-2dd8-4f24-b89b-b2d4a48b4f70 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:12.495222 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e9a001a-2dd8-4f24-b89b-b2d4a48b4f70 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:12.495984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e9a001a-2dd8-4f24-b89b-b2d4a48b4f70 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:12.496413 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e9a001a-2dd8-4f24-b89b-b2d4a48b4f70 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:12.559607 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1e9a001a-2dd8-4f24-b89b-b2d4a48b4f70 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:12.568350 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1e9a001a-2dd8-4f24-b89b-b2d4a48b4f70 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085445 Jun 02 16:18:12.568926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 539/1094] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:13.585868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f9bb18a4-9628-4440-8215-70ca40fcd3c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:13.586458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f9bb18a4-9628-4440-8215-70ca40fcd3c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:13.588792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=30 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:18:13.593608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9bb18a4-9628-4440-8215-70ca40fcd3c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:13.594056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9bb18a4-9628-4440-8215-70ca40fcd3c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:13.595179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9bb18a4-9628-4440-8215-70ca40fcd3c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:13.595642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9bb18a4-9628-4440-8215-70ca40fcd3c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:13.657387 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f9bb18a4-9628-4440-8215-70ca40fcd3c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:13.664961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f9bb18a4-9628-4440-8215-70ca40fcd3c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083058 Jun 02 16:18:13.665528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 556/1095] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:13 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:14.681833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ee12f156-7b98-4b2f-ab61-2cfa6ae1a9a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:14.684248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ee12f156-7b98-4b2f-ab61-2cfa6ae1a9a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:14.684882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:18:14.690225 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee12f156-7b98-4b2f-ab61-2cfa6ae1a9a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:14.690703 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee12f156-7b98-4b2f-ab61-2cfa6ae1a9a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:14.691503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee12f156-7b98-4b2f-ab61-2cfa6ae1a9a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:14.691941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee12f156-7b98-4b2f-ab61-2cfa6ae1a9a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:14.695945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=84 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:18:14.753312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ee12f156-7b98-4b2f-ab61-2cfa6ae1a9a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:14.760925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ee12f156-7b98-4b2f-ab61-2cfa6ae1a9a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082981 Jun 02 16:18:14.761492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 540/1096] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:15.778315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4b067bb9-9e8e-470e-b639-b7fa60e955fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:15.778954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4b067bb9-9e8e-470e-b639-b7fa60e955fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:15.786327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4b067bb9-9e8e-470e-b639-b7fa60e955fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:15.786776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4b067bb9-9e8e-470e-b639-b7fa60e955fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:15.787540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4b067bb9-9e8e-470e-b639-b7fa60e955fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:15.787977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4b067bb9-9e8e-470e-b639-b7fa60e955fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:15.791833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:18:15.853533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4b067bb9-9e8e-470e-b639-b7fa60e955fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:15.861702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4b067bb9-9e8e-470e-b639-b7fa60e955fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087254 Jun 02 16:18:15.862286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 557/1097] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:16.877995 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4eef6954-0944-41ab-992d-94fdc18b0349 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:16.878631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4eef6954-0944-41ab-992d-94fdc18b0349 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:16.884620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4eef6954-0944-41ab-992d-94fdc18b0349 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:16.885063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4eef6954-0944-41ab-992d-94fdc18b0349 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:16.885829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4eef6954-0944-41ab-992d-94fdc18b0349 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:16.886292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4eef6954-0944-41ab-992d-94fdc18b0349 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:16.949180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4eef6954-0944-41ab-992d-94fdc18b0349 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:16.957260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4eef6954-0944-41ab-992d-94fdc18b0349 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083503 Jun 02 16:18:16.957831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 541/1098] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:16 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:17.974978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9a70da11-5a4d-4779-a46f-096576e111bc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:17.975599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9a70da11-5a4d-4779-a46f-096576e111bc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:17.982882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a70da11-5a4d-4779-a46f-096576e111bc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:17.983339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a70da11-5a4d-4779-a46f-096576e111bc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:17.984118 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a70da11-5a4d-4779-a46f-096576e111bc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:17.984569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a70da11-5a4d-4779-a46f-096576e111bc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:18.045771 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9a70da11-5a4d-4779-a46f-096576e111bc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:18.054148 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9a70da11-5a4d-4779-a46f-096576e111bc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083460 Jun 02 16:18:18.054717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 558/1099] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:17 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:19.124761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c7e4df57-4d34-4408-861f-ef9fb2e4b3af tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:19.125847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c7e4df57-4d34-4408-861f-ef9fb2e4b3af tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:19.132485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7e4df57-4d34-4408-861f-ef9fb2e4b3af tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:19.132939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7e4df57-4d34-4408-861f-ef9fb2e4b3af tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:19.133702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7e4df57-4d34-4408-861f-ef9fb2e4b3af tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:19.134165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c7e4df57-4d34-4408-861f-ef9fb2e4b3af tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:19.195636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c7e4df57-4d34-4408-861f-ef9fb2e4b3af tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:19.203138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c7e4df57-4d34-4408-861f-ef9fb2e4b3af tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082209 Jun 02 16:18:19.203704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 542/1100] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:20.219003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6845be21-83b5-424f-bdf0-d4f83f74c1cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:20.222730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6845be21-83b5-424f-bdf0-d4f83f74c1cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:20.227117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6845be21-83b5-424f-bdf0-d4f83f74c1cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:20.227560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6845be21-83b5-424f-bdf0-d4f83f74c1cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:20.228337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6845be21-83b5-424f-bdf0-d4f83f74c1cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:20.228781 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6845be21-83b5-424f-bdf0-d4f83f74c1cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:20.292088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6845be21-83b5-424f-bdf0-d4f83f74c1cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:20.300147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6845be21-83b5-424f-bdf0-d4f83f74c1cc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085013 Jun 02 16:18:20.303170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 559/1101] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:20 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:21.317538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3d6c3221-2a89-4baf-8c39-ca156cb3d724 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:21.318177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3d6c3221-2a89-4baf-8c39-ca156cb3d724 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:21.324637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3d6c3221-2a89-4baf-8c39-ca156cb3d724 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:21.325083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3d6c3221-2a89-4baf-8c39-ca156cb3d724 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:21.325890 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3d6c3221-2a89-4baf-8c39-ca156cb3d724 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:21.326342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3d6c3221-2a89-4baf-8c39-ca156cb3d724 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:21.388248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3d6c3221-2a89-4baf-8c39-ca156cb3d724 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:21.396354 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3d6c3221-2a89-4baf-8c39-ca156cb3d724 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083613 Jun 02 16:18:21.396925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 543/1102] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:22.413305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a897e50d-50fb-437a-bc4d-1d0e0a550f69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:22.413924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a897e50d-50fb-437a-bc4d-1d0e0a550f69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:22.420449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a897e50d-50fb-437a-bc4d-1d0e0a550f69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:22.420901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a897e50d-50fb-437a-bc4d-1d0e0a550f69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:22.421669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a897e50d-50fb-437a-bc4d-1d0e0a550f69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:22.422161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a897e50d-50fb-437a-bc4d-1d0e0a550f69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:22.484093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a897e50d-50fb-437a-bc4d-1d0e0a550f69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:22.491867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a897e50d-50fb-437a-bc4d-1d0e0a550f69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082491 Jun 02 16:18:22.492436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 560/1103] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:23.509462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9f2458f1-3138-4d24-b0d1-6365c8c8aca3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:23.510004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9f2458f1-3138-4d24-b0d1-6365c8c8aca3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:23.516637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f2458f1-3138-4d24-b0d1-6365c8c8aca3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:23.517088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f2458f1-3138-4d24-b0d1-6365c8c8aca3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:23.517847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f2458f1-3138-4d24-b0d1-6365c8c8aca3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:23.518312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f2458f1-3138-4d24-b0d1-6365c8c8aca3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:23.580600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9f2458f1-3138-4d24-b0d1-6365c8c8aca3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:23.588116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9f2458f1-3138-4d24-b0d1-6365c8c8aca3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082629 Jun 02 16:18:23.588682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 544/1104] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:23 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:24.606001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8ecf47be-2e71-45aa-aeac-ca6020bb47c8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:24.606673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8ecf47be-2e71-45aa-aeac-ca6020bb47c8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:24.613727 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ecf47be-2e71-45aa-aeac-ca6020bb47c8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:24.617157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ecf47be-2e71-45aa-aeac-ca6020bb47c8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:24.617157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ecf47be-2e71-45aa-aeac-ca6020bb47c8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:24.617157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ecf47be-2e71-45aa-aeac-ca6020bb47c8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:24.680126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8ecf47be-2e71-45aa-aeac-ca6020bb47c8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:24.687642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8ecf47be-2e71-45aa-aeac-ca6020bb47c8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085606 Jun 02 16:18:24.688204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 561/1105] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:24 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:25.705780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b8baf043-e459-4876-a4e5-e6a102b5ad41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:25.706745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b8baf043-e459-4876-a4e5-e6a102b5ad41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:25.713056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b8baf043-e459-4876-a4e5-e6a102b5ad41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:25.713506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b8baf043-e459-4876-a4e5-e6a102b5ad41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:25.714319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b8baf043-e459-4876-a4e5-e6a102b5ad41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:25.714760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b8baf043-e459-4876-a4e5-e6a102b5ad41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:25.781851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b8baf043-e459-4876-a4e5-e6a102b5ad41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:25.789841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b8baf043-e459-4876-a4e5-e6a102b5ad41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.089072 Jun 02 16:18:25.790510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 545/1106] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:25 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:26.806773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-76bda1e2-a84c-425f-9d38-bc1045d36343 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:26.807412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-76bda1e2-a84c-425f-9d38-bc1045d36343 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:26.814055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76bda1e2-a84c-425f-9d38-bc1045d36343 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:26.814535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76bda1e2-a84c-425f-9d38-bc1045d36343 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:26.815306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76bda1e2-a84c-425f-9d38-bc1045d36343 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:26.815745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76bda1e2-a84c-425f-9d38-bc1045d36343 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:26.875930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-76bda1e2-a84c-425f-9d38-bc1045d36343 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:26.883718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-76bda1e2-a84c-425f-9d38-bc1045d36343 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080841 Jun 02 16:18:26.884479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 562/1107] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:26 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:27.901045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a761b6a9-66c2-4bd1-9358-0a7c0bc5ec44 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:27.901601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a761b6a9-66c2-4bd1-9358-0a7c0bc5ec44 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:27.908511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a761b6a9-66c2-4bd1-9358-0a7c0bc5ec44 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:27.908951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a761b6a9-66c2-4bd1-9358-0a7c0bc5ec44 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:27.909699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a761b6a9-66c2-4bd1-9358-0a7c0bc5ec44 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:27.910152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a761b6a9-66c2-4bd1-9358-0a7c0bc5ec44 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:28.222662 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a761b6a9-66c2-4bd1-9358-0a7c0bc5ec44 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:28.230360 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a761b6a9-66c2-4bd1-9358-0a7c0bc5ec44 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.333323 Jun 02 16:18:28.230919 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 546/1108] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:27 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:29.247608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8d81e0b2-6e05-4b42-bd88-5b83347010dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:29.249531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8d81e0b2-6e05-4b42-bd88-5b83347010dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:29.255981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d81e0b2-6e05-4b42-bd88-5b83347010dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:29.256438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d81e0b2-6e05-4b42-bd88-5b83347010dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:29.257208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d81e0b2-6e05-4b42-bd88-5b83347010dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:29.257712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d81e0b2-6e05-4b42-bd88-5b83347010dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:29.318889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8d81e0b2-6e05-4b42-bd88-5b83347010dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:29.326347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8d81e0b2-6e05-4b42-bd88-5b83347010dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082629 Jun 02 16:18:29.326904 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 563/1109] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:29 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:30.343926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c821cf2c-5797-44b6-b3e8-3ebdae470933 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:30.344534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c821cf2c-5797-44b6-b3e8-3ebdae470933 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:30.351518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c821cf2c-5797-44b6-b3e8-3ebdae470933 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:30.352025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c821cf2c-5797-44b6-b3e8-3ebdae470933 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:30.352828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c821cf2c-5797-44b6-b3e8-3ebdae470933 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:30.353266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c821cf2c-5797-44b6-b3e8-3ebdae470933 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:30.415284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c821cf2c-5797-44b6-b3e8-3ebdae470933 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:30.422774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c821cf2c-5797-44b6-b3e8-3ebdae470933 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082752 Jun 02 16:18:30.423337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 547/1110] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:30 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:31.440759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b8eac997-3e56-450b-b3f8-1524d703512e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:31.441290 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b8eac997-3e56-450b-b3f8-1524d703512e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:31.447732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8eac997-3e56-450b-b3f8-1524d703512e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:31.448183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8eac997-3e56-450b-b3f8-1524d703512e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:31.448940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8eac997-3e56-450b-b3f8-1524d703512e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:31.449378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8eac997-3e56-450b-b3f8-1524d703512e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:31.512400 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b8eac997-3e56-450b-b3f8-1524d703512e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:31.520536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b8eac997-3e56-450b-b3f8-1524d703512e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084248 Jun 02 16:18:31.521096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 564/1111] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:31 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:32.537754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4ca41342-e7af-46e8-898e-9e670a66088b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:32.538348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4ca41342-e7af-46e8-898e-9e670a66088b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:32.544871 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ca41342-e7af-46e8-898e-9e670a66088b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:32.545321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ca41342-e7af-46e8-898e-9e670a66088b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:32.546116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ca41342-e7af-46e8-898e-9e670a66088b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:32.546560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4ca41342-e7af-46e8-898e-9e670a66088b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:32.607810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4ca41342-e7af-46e8-898e-9e670a66088b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:32.616409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4ca41342-e7af-46e8-898e-9e670a66088b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083579 Jun 02 16:18:32.616974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 548/1112] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:32 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:33.633745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b9af8d8e-9864-42e2-8011-37c623dce4b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:33.634341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b9af8d8e-9864-42e2-8011-37c623dce4b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:33.640785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b9af8d8e-9864-42e2-8011-37c623dce4b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:33.641229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b9af8d8e-9864-42e2-8011-37c623dce4b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:33.641974 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b9af8d8e-9864-42e2-8011-37c623dce4b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:33.642427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b9af8d8e-9864-42e2-8011-37c623dce4b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:33.704748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b9af8d8e-9864-42e2-8011-37c623dce4b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:33.712774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b9af8d8e-9864-42e2-8011-37c623dce4b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082945 Jun 02 16:18:33.713327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 565/1113] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:33 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:34.730173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-58700d80-84ff-41ac-956e-ad5a622adda0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:34.730792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-58700d80-84ff-41ac-956e-ad5a622adda0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:34.737747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58700d80-84ff-41ac-956e-ad5a622adda0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:34.738247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58700d80-84ff-41ac-956e-ad5a622adda0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:34.739031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58700d80-84ff-41ac-956e-ad5a622adda0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:34.739471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58700d80-84ff-41ac-956e-ad5a622adda0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:34.801563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-58700d80-84ff-41ac-956e-ad5a622adda0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:34.809056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-58700d80-84ff-41ac-956e-ad5a622adda0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082866 Jun 02 16:18:34.809630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 549/1114] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:34 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:35.825768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8fe78c95-3157-4f9e-928a-332e6efb1e02 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:35.826408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8fe78c95-3157-4f9e-928a-332e6efb1e02 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:35.833092 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fe78c95-3157-4f9e-928a-332e6efb1e02 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:35.833542 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fe78c95-3157-4f9e-928a-332e6efb1e02 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:35.834339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fe78c95-3157-4f9e-928a-332e6efb1e02 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:35.834776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8fe78c95-3157-4f9e-928a-332e6efb1e02 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:35.896033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8fe78c95-3157-4f9e-928a-332e6efb1e02 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:35.903561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8fe78c95-3157-4f9e-928a-332e6efb1e02 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081612 Jun 02 16:18:35.904125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 566/1115] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:35 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:37.125407 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-80e26e49-7305-4736-9779-e813bdacccd7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:37.126023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-80e26e49-7305-4736-9779-e813bdacccd7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:37.131979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80e26e49-7305-4736-9779-e813bdacccd7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:37.132425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80e26e49-7305-4736-9779-e813bdacccd7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:37.133183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80e26e49-7305-4736-9779-e813bdacccd7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:37.133617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80e26e49-7305-4736-9779-e813bdacccd7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:37.196632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-80e26e49-7305-4736-9779-e813bdacccd7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:37.204151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-80e26e49-7305-4736-9779-e813bdacccd7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.287348 Jun 02 16:18:37.204716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 550/1116] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:36 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:38.220687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3a64e8ca-467a-4263-b1cf-3b5a9643d433 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:38.221597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3a64e8ca-467a-4263-b1cf-3b5a9643d433 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:38.228194 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a64e8ca-467a-4263-b1cf-3b5a9643d433 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:38.228640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a64e8ca-467a-4263-b1cf-3b5a9643d433 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:38.229401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a64e8ca-467a-4263-b1cf-3b5a9643d433 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:38.229837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3a64e8ca-467a-4263-b1cf-3b5a9643d433 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:38.291825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3a64e8ca-467a-4263-b1cf-3b5a9643d433 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:38.300208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3a64e8ca-467a-4263-b1cf-3b5a9643d433 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083414 Jun 02 16:18:38.300766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 567/1117] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:38 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:39.316900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-204aefb1-4053-43ec-ad6f-d8677219b604 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:39.317508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-204aefb1-4053-43ec-ad6f-d8677219b604 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:39.324131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-204aefb1-4053-43ec-ad6f-d8677219b604 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:39.324584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-204aefb1-4053-43ec-ad6f-d8677219b604 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:39.325380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-204aefb1-4053-43ec-ad6f-d8677219b604 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:39.325820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-204aefb1-4053-43ec-ad6f-d8677219b604 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:39.389185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-204aefb1-4053-43ec-ad6f-d8677219b604 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:39.397383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-204aefb1-4053-43ec-ad6f-d8677219b604 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084491 Jun 02 16:18:39.397954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 551/1118] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:39 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:40.414465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-daf08bf1-111c-47f9-ad86-20b3f49f1828 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:40.415077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-daf08bf1-111c-47f9-ad86-20b3f49f1828 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:40.421143 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-daf08bf1-111c-47f9-ad86-20b3f49f1828 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:40.421591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-daf08bf1-111c-47f9-ad86-20b3f49f1828 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:40.422379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-daf08bf1-111c-47f9-ad86-20b3f49f1828 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:40.422868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-daf08bf1-111c-47f9-ad86-20b3f49f1828 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:40.486693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-daf08bf1-111c-47f9-ad86-20b3f49f1828 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:40.494397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-daf08bf1-111c-47f9-ad86-20b3f49f1828 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083753 Jun 02 16:18:40.494956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 568/1119] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:40 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:41.511235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-abf0d40a-0790-4ce5-a8c8-ca7c622abeb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:41.511853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-abf0d40a-0790-4ce5-a8c8-ca7c622abeb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:41.519371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-abf0d40a-0790-4ce5-a8c8-ca7c622abeb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:41.520201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-abf0d40a-0790-4ce5-a8c8-ca7c622abeb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:41.520990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-abf0d40a-0790-4ce5-a8c8-ca7c622abeb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:41.521430 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-abf0d40a-0790-4ce5-a8c8-ca7c622abeb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:41.616735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-abf0d40a-0790-4ce5-a8c8-ca7c622abeb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:41.624740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-abf0d40a-0790-4ce5-a8c8-ca7c622abeb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.117297 Jun 02 16:18:41.625313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 552/1120] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:41 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:42.641335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e46b9d5f-21a5-4cf3-9c7f-d0f63195d5e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:42.641891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e46b9d5f-21a5-4cf3-9c7f-d0f63195d5e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:42.648594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e46b9d5f-21a5-4cf3-9c7f-d0f63195d5e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:42.649047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e46b9d5f-21a5-4cf3-9c7f-d0f63195d5e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:42.649821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e46b9d5f-21a5-4cf3-9c7f-d0f63195d5e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:42.650296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e46b9d5f-21a5-4cf3-9c7f-d0f63195d5e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:42.714975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e46b9d5f-21a5-4cf3-9c7f-d0f63195d5e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:42.723213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e46b9d5f-21a5-4cf3-9c7f-d0f63195d5e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085819 Jun 02 16:18:42.723810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 569/1121] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:42 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:43.740455 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-40c68a03-1b8d-4486-b1f6-2feffc8cec7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:43.741100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-40c68a03-1b8d-4486-b1f6-2feffc8cec7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:43.747603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40c68a03-1b8d-4486-b1f6-2feffc8cec7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:43.748055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40c68a03-1b8d-4486-b1f6-2feffc8cec7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:43.748821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40c68a03-1b8d-4486-b1f6-2feffc8cec7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:43.749251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40c68a03-1b8d-4486-b1f6-2feffc8cec7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:43.816921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-40c68a03-1b8d-4486-b1f6-2feffc8cec7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:43.824493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-40c68a03-1b8d-4486-b1f6-2feffc8cec7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.088426 Jun 02 16:18:43.825054 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 553/1122] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:43 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:18:44.841875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eb10802b-7146-43a8-8278-5f2cff884329 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:44.842520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eb10802b-7146-43a8-8278-5f2cff884329 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:44.844871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=28 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:18:44.849955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb10802b-7146-43a8-8278-5f2cff884329 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:44.850440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb10802b-7146-43a8-8278-5f2cff884329 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:44.851209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb10802b-7146-43a8-8278-5f2cff884329 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:44.851650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb10802b-7146-43a8-8278-5f2cff884329 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:44.914349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-eb10802b-7146-43a8-8278-5f2cff884329 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:44.921785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eb10802b-7146-43a8-8278-5f2cff884329 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083789 Jun 02 16:18:44.922383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 570/1123] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:44 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:45.938607 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d961e6dc-6009-40ed-9892-21c46de2060f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:45.939252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d961e6dc-6009-40ed-9892-21c46de2060f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:45.941846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:18:45.946552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d961e6dc-6009-40ed-9892-21c46de2060f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:45.946993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d961e6dc-6009-40ed-9892-21c46de2060f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:45.947749 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d961e6dc-6009-40ed-9892-21c46de2060f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:45.948183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d961e6dc-6009-40ed-9892-21c46de2060f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:45.952042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=84 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:18:46.011790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d961e6dc-6009-40ed-9892-21c46de2060f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:46.019728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d961e6dc-6009-40ed-9892-21c46de2060f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084952 Jun 02 16:18:46.020293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 554/1124] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:45 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:47.037192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5d5e7cb7-d6a6-43f2-b32a-ec9b324f7ae6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:47.037834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5d5e7cb7-d6a6-43f2-b32a-ec9b324f7ae6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:47.044406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d5e7cb7-d6a6-43f2-b32a-ec9b324f7ae6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:47.044863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d5e7cb7-d6a6-43f2-b32a-ec9b324f7ae6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:47.045627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d5e7cb7-d6a6-43f2-b32a-ec9b324f7ae6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:47.046067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d5e7cb7-d6a6-43f2-b32a-ec9b324f7ae6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:47.050643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:18:47.110768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5d5e7cb7-d6a6-43f2-b32a-ec9b324f7ae6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:47.119337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5d5e7cb7-d6a6-43f2-b32a-ec9b324f7ae6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086722 Jun 02 16:18:47.119902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 571/1125] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:47 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:48.136666 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3aa18aa9-20c6-40d6-a6e2-6a1bf9b11928 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:48.137212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3aa18aa9-20c6-40d6-a6e2-6a1bf9b11928 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:48.143280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3aa18aa9-20c6-40d6-a6e2-6a1bf9b11928 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:48.144609 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3aa18aa9-20c6-40d6-a6e2-6a1bf9b11928 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:48.145398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3aa18aa9-20c6-40d6-a6e2-6a1bf9b11928 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:48.145843 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3aa18aa9-20c6-40d6-a6e2-6a1bf9b11928 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:48.207398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3aa18aa9-20c6-40d6-a6e2-6a1bf9b11928 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:48.214836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3aa18aa9-20c6-40d6-a6e2-6a1bf9b11928 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082587 Jun 02 16:18:48.215408 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 555/1126] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:48 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:49.232085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bf40dfb7-0cbc-4285-a212-0f7d1b8d5296 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:49.232701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bf40dfb7-0cbc-4285-a212-0f7d1b8d5296 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:49.239595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf40dfb7-0cbc-4285-a212-0f7d1b8d5296 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:49.240046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf40dfb7-0cbc-4285-a212-0f7d1b8d5296 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:49.240813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf40dfb7-0cbc-4285-a212-0f7d1b8d5296 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:49.241256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf40dfb7-0cbc-4285-a212-0f7d1b8d5296 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:49.302600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bf40dfb7-0cbc-4285-a212-0f7d1b8d5296 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:49.310029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bf40dfb7-0cbc-4285-a212-0f7d1b8d5296 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081840 Jun 02 16:18:49.310645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 572/1127] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:49 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:50.327529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-03111315-009a-489f-af8e-00b7262b550b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:50.328147 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-03111315-009a-489f-af8e-00b7262b550b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:50.335359 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-03111315-009a-489f-af8e-00b7262b550b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:50.335810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-03111315-009a-489f-af8e-00b7262b550b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:50.336580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-03111315-009a-489f-af8e-00b7262b550b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:50.337024 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-03111315-009a-489f-af8e-00b7262b550b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:50.398936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-03111315-009a-489f-af8e-00b7262b550b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:50.406410 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-03111315-009a-489f-af8e-00b7262b550b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082939 Jun 02 16:18:50.406982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 556/1128] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:50 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:18:51.427460 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-987709c2-e591-4a02-af51-171e18efea2d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:51.427460 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-987709c2-e591-4a02-af51-171e18efea2d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:51.430915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-987709c2-e591-4a02-af51-171e18efea2d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:51.431362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-987709c2-e591-4a02-af51-171e18efea2d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:51.432153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-987709c2-e591-4a02-af51-171e18efea2d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:51.432588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-987709c2-e591-4a02-af51-171e18efea2d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:51.497329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-987709c2-e591-4a02-af51-171e18efea2d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:51.505561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-987709c2-e591-4a02-af51-171e18efea2d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086422 Jun 02 16:18:51.506130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 573/1129] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:51 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:52.523070 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8e85b803-11ea-46e5-9173-dfe3a7c59f45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:52.523614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8e85b803-11ea-46e5-9173-dfe3a7c59f45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:52.530199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e85b803-11ea-46e5-9173-dfe3a7c59f45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:52.530653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e85b803-11ea-46e5-9173-dfe3a7c59f45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:52.531432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e85b803-11ea-46e5-9173-dfe3a7c59f45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:52.531912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e85b803-11ea-46e5-9173-dfe3a7c59f45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:52.597660 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8e85b803-11ea-46e5-9173-dfe3a7c59f45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:52.605217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8e85b803-11ea-46e5-9173-dfe3a7c59f45 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086825 Jun 02 16:18:52.605778 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 557/1130] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:52 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:53.622728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1f9480c3-c742-4255-a33e-6d79fb88446e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:53.623283 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1f9480c3-c742-4255-a33e-6d79fb88446e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:53.629687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f9480c3-c742-4255-a33e-6d79fb88446e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:53.630163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f9480c3-c742-4255-a33e-6d79fb88446e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:53.630914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f9480c3-c742-4255-a33e-6d79fb88446e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:53.631341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f9480c3-c742-4255-a33e-6d79fb88446e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:53.690791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1f9480c3-c742-4255-a33e-6d79fb88446e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:53.697987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1f9480c3-c742-4255-a33e-6d79fb88446e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079269 Jun 02 16:18:53.698572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 574/1131] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:53 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:54.715234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d25775ac-0f07-4081-b2f0-c5261a35a32c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:54.715828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d25775ac-0f07-4081-b2f0-c5261a35a32c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:54.723557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d25775ac-0f07-4081-b2f0-c5261a35a32c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:54.723557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d25775ac-0f07-4081-b2f0-c5261a35a32c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:54.724491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d25775ac-0f07-4081-b2f0-c5261a35a32c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:54.724925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d25775ac-0f07-4081-b2f0-c5261a35a32c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:54.788508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d25775ac-0f07-4081-b2f0-c5261a35a32c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:54.795934 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d25775ac-0f07-4081-b2f0-c5261a35a32c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084563 Jun 02 16:18:54.796501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 558/1132] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:54 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:55.812638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-16e58809-a5a7-4723-8de7-eb49ef04b955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:55.813231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-16e58809-a5a7-4723-8de7-eb49ef04b955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:55.820251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16e58809-a5a7-4723-8de7-eb49ef04b955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:55.820701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16e58809-a5a7-4723-8de7-eb49ef04b955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:55.821455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16e58809-a5a7-4723-8de7-eb49ef04b955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:55.821888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16e58809-a5a7-4723-8de7-eb49ef04b955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:55.887269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-16e58809-a5a7-4723-8de7-eb49ef04b955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:55.895319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-16e58809-a5a7-4723-8de7-eb49ef04b955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086539 Jun 02 16:18:55.895889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 575/1133] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:55 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:18:56.912904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7ab9cda4-c829-406b-9ae7-b95f7fde4c9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:56.913507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7ab9cda4-c829-406b-9ae7-b95f7fde4c9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:56.920074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ab9cda4-c829-406b-9ae7-b95f7fde4c9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:56.920516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ab9cda4-c829-406b-9ae7-b95f7fde4c9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:56.921276 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ab9cda4-c829-406b-9ae7-b95f7fde4c9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:56.921703 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ab9cda4-c829-406b-9ae7-b95f7fde4c9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:56.981684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7ab9cda4-c829-406b-9ae7-b95f7fde4c9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:56.989364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7ab9cda4-c829-406b-9ae7-b95f7fde4c9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081156 Jun 02 16:18:56.989921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 559/1134] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:56 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:58.005659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c246d8c9-024f-4362-aaa3-30008fcaeb9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:58.006305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c246d8c9-024f-4362-aaa3-30008fcaeb9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:58.013003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c246d8c9-024f-4362-aaa3-30008fcaeb9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:58.013448 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c246d8c9-024f-4362-aaa3-30008fcaeb9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:58.014240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c246d8c9-024f-4362-aaa3-30008fcaeb9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:58.014674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c246d8c9-024f-4362-aaa3-30008fcaeb9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:58.075020 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c246d8c9-024f-4362-aaa3-30008fcaeb9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:58.082363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c246d8c9-024f-4362-aaa3-30008fcaeb9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080626 Jun 02 16:18:58.082928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 576/1135] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:58 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:18:59.098646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6344578f-aef0-430a-a430-e6f5f4e7fdae tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:18:59.099327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6344578f-aef0-430a-a430-e6f5f4e7fdae tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:18:59.106010 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6344578f-aef0-430a-a430-e6f5f4e7fdae tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:59.106499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6344578f-aef0-430a-a430-e6f5f4e7fdae tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:59.107277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6344578f-aef0-430a-a430-e6f5f4e7fdae tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:18:59.107719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6344578f-aef0-430a-a430-e6f5f4e7fdae tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:18:59.170252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6344578f-aef0-430a-a430-e6f5f4e7fdae tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:18:59.178029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6344578f-aef0-430a-a430-e6f5f4e7fdae tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083418 Jun 02 16:18:59.178629 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 560/1136] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:18:59 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:00.195071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-40974026-5e40-40f2-951b-11a516702cec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:00.195673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-40974026-5e40-40f2-951b-11a516702cec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:00.202388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40974026-5e40-40f2-951b-11a516702cec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:00.202833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40974026-5e40-40f2-951b-11a516702cec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:00.203603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40974026-5e40-40f2-951b-11a516702cec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:00.204034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40974026-5e40-40f2-951b-11a516702cec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:00.270307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-40974026-5e40-40f2-951b-11a516702cec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:00.278021 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-40974026-5e40-40f2-951b-11a516702cec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087761 Jun 02 16:19:00.281035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 577/1137] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:00 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:01.295145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e88d3329-07ca-413f-b279-34cd9483c8a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:01.295763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e88d3329-07ca-413f-b279-34cd9483c8a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:01.302413 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e88d3329-07ca-413f-b279-34cd9483c8a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:01.302879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e88d3329-07ca-413f-b279-34cd9483c8a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:01.303645 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e88d3329-07ca-413f-b279-34cd9483c8a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:01.304081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e88d3329-07ca-413f-b279-34cd9483c8a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:01.368259 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e88d3329-07ca-413f-b279-34cd9483c8a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:01.375752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e88d3329-07ca-413f-b279-34cd9483c8a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084776 Jun 02 16:19:01.376312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 561/1138] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:01 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:02.392591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-049c3e76-42e1-49b6-8a97-c160958909e9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:02.393206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-049c3e76-42e1-49b6-8a97-c160958909e9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:02.400778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-049c3e76-42e1-49b6-8a97-c160958909e9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:02.401236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-049c3e76-42e1-49b6-8a97-c160958909e9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:02.402000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-049c3e76-42e1-49b6-8a97-c160958909e9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:02.402465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-049c3e76-42e1-49b6-8a97-c160958909e9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:02.463324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-049c3e76-42e1-49b6-8a97-c160958909e9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:02.471171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-049c3e76-42e1-49b6-8a97-c160958909e9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082189 Jun 02 16:19:02.471738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 578/1139] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:02 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:03.488679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8e6ce8f5-f195-4228-ac74-41356954357c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:03.490366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8e6ce8f5-f195-4228-ac74-41356954357c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:03.496943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e6ce8f5-f195-4228-ac74-41356954357c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:03.497398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e6ce8f5-f195-4228-ac74-41356954357c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:03.498194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e6ce8f5-f195-4228-ac74-41356954357c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:03.498640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e6ce8f5-f195-4228-ac74-41356954357c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:03.560258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8e6ce8f5-f195-4228-ac74-41356954357c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:03.567865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8e6ce8f5-f195-4228-ac74-41356954357c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082896 Jun 02 16:19:03.568419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 562/1140] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:03 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:04.585014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1e47e93d-766f-4d67-ace0-2fcaee1f5f28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:04.585590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1e47e93d-766f-4d67-ace0-2fcaee1f5f28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:04.592122 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e47e93d-766f-4d67-ace0-2fcaee1f5f28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:04.592572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e47e93d-766f-4d67-ace0-2fcaee1f5f28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:04.593338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e47e93d-766f-4d67-ace0-2fcaee1f5f28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:04.593774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e47e93d-766f-4d67-ace0-2fcaee1f5f28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:04.655859 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1e47e93d-766f-4d67-ace0-2fcaee1f5f28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:04.663395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1e47e93d-766f-4d67-ace0-2fcaee1f5f28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082766 Jun 02 16:19:04.663958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 579/1141] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:04 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:05.680807 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1aea3a3e-6ad2-4dff-8b5d-3feaa77592a5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:05.681413 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1aea3a3e-6ad2-4dff-8b5d-3feaa77592a5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:05.687827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1aea3a3e-6ad2-4dff-8b5d-3feaa77592a5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:05.690724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1aea3a3e-6ad2-4dff-8b5d-3feaa77592a5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:05.690724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1aea3a3e-6ad2-4dff-8b5d-3feaa77592a5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:05.690724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1aea3a3e-6ad2-4dff-8b5d-3feaa77592a5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:05.752382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1aea3a3e-6ad2-4dff-8b5d-3feaa77592a5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:05.760109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1aea3a3e-6ad2-4dff-8b5d-3feaa77592a5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083819 Jun 02 16:19:05.760769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 563/1142] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:06.776984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-da1a86eb-f54a-4ac3-a15f-e2b2d03133eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:06.777602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-da1a86eb-f54a-4ac3-a15f-e2b2d03133eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:06.784166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da1a86eb-f54a-4ac3-a15f-e2b2d03133eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:06.784616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da1a86eb-f54a-4ac3-a15f-e2b2d03133eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:06.785383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da1a86eb-f54a-4ac3-a15f-e2b2d03133eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:06.786047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da1a86eb-f54a-4ac3-a15f-e2b2d03133eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:06.846736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-da1a86eb-f54a-4ac3-a15f-e2b2d03133eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:06.854525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-da1a86eb-f54a-4ac3-a15f-e2b2d03133eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081386 Jun 02 16:19:06.855094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 580/1143] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:06 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:07.871245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0754da5b-e6da-493b-8531-4f9db8d3b73a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:07.871791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0754da5b-e6da-493b-8531-4f9db8d3b73a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:07.878379 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0754da5b-e6da-493b-8531-4f9db8d3b73a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:07.878831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0754da5b-e6da-493b-8531-4f9db8d3b73a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:07.879669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0754da5b-e6da-493b-8531-4f9db8d3b73a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:07.880140 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0754da5b-e6da-493b-8531-4f9db8d3b73a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:07.941806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0754da5b-e6da-493b-8531-4f9db8d3b73a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:07.949389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0754da5b-e6da-493b-8531-4f9db8d3b73a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082099 Jun 02 16:19:07.949975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 564/1144] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:07 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:08.966247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-93acde31-76ab-47b7-a77d-0c95ed5cd0a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:08.966773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-93acde31-76ab-47b7-a77d-0c95ed5cd0a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:08.974113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-93acde31-76ab-47b7-a77d-0c95ed5cd0a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:08.974562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-93acde31-76ab-47b7-a77d-0c95ed5cd0a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:08.975319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-93acde31-76ab-47b7-a77d-0c95ed5cd0a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:08.975752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-93acde31-76ab-47b7-a77d-0c95ed5cd0a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:09.038889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-93acde31-76ab-47b7-a77d-0c95ed5cd0a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:09.046258 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-93acde31-76ab-47b7-a77d-0c95ed5cd0a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083995 Jun 02 16:19:09.046822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 581/1145] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:08 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:19:10.063177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6bbe8b12-8aea-41d4-a556-3acddc6b7772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:10.063814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6bbe8b12-8aea-41d4-a556-3acddc6b7772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:10.070854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bbe8b12-8aea-41d4-a556-3acddc6b7772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:10.071303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bbe8b12-8aea-41d4-a556-3acddc6b7772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:10.072057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bbe8b12-8aea-41d4-a556-3acddc6b7772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:10.072488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bbe8b12-8aea-41d4-a556-3acddc6b7772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:10.137679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6bbe8b12-8aea-41d4-a556-3acddc6b7772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:10.145122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6bbe8b12-8aea-41d4-a556-3acddc6b7772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085891 Jun 02 16:19:10.151267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 565/1146] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:11.162533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d0ca8c38-ccd5-4290-889c-cacc6035fae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:11.163134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d0ca8c38-ccd5-4290-889c-cacc6035fae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:11.169278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0ca8c38-ccd5-4290-889c-cacc6035fae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:11.169731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0ca8c38-ccd5-4290-889c-cacc6035fae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:11.170534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0ca8c38-ccd5-4290-889c-cacc6035fae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:11.170978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0ca8c38-ccd5-4290-889c-cacc6035fae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:11.234604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d0ca8c38-ccd5-4290-889c-cacc6035fae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:11.242987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d0ca8c38-ccd5-4290-889c-cacc6035fae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084955 Jun 02 16:19:11.243557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 582/1147] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:12.259119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-eaed15de-6f1d-49b3-8305-5600d3d35163 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:12.259736 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-eaed15de-6f1d-49b3-8305-5600d3d35163 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:12.266234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eaed15de-6f1d-49b3-8305-5600d3d35163 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:12.266684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eaed15de-6f1d-49b3-8305-5600d3d35163 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:12.267449 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eaed15de-6f1d-49b3-8305-5600d3d35163 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:12.267884 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eaed15de-6f1d-49b3-8305-5600d3d35163 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:12.328766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eaed15de-6f1d-49b3-8305-5600d3d35163 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:12.336789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-eaed15de-6f1d-49b3-8305-5600d3d35163 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081608 Jun 02 16:19:12.337357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 566/1148] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:13.353810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f681b760-e268-4688-876d-b61037aa43a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:13.354428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f681b760-e268-4688-876d-b61037aa43a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:13.360990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f681b760-e268-4688-876d-b61037aa43a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:13.361447 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f681b760-e268-4688-876d-b61037aa43a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:13.362241 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f681b760-e268-4688-876d-b61037aa43a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:13.362684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f681b760-e268-4688-876d-b61037aa43a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:13.423106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f681b760-e268-4688-876d-b61037aa43a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:13.431594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f681b760-e268-4688-876d-b61037aa43a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081665 Jun 02 16:19:13.432155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 583/1149] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:13 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:14.448963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-87008f29-26bf-4878-a0ff-dd7a19335f76 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:14.449544 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-87008f29-26bf-4878-a0ff-dd7a19335f76 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:14.456229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87008f29-26bf-4878-a0ff-dd7a19335f76 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:14.456672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87008f29-26bf-4878-a0ff-dd7a19335f76 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:14.457458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87008f29-26bf-4878-a0ff-dd7a19335f76 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:14.457978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87008f29-26bf-4878-a0ff-dd7a19335f76 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:14.519795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-87008f29-26bf-4878-a0ff-dd7a19335f76 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:14.527381 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-87008f29-26bf-4878-a0ff-dd7a19335f76 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082295 Jun 02 16:19:14.527948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 567/1150] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:15.544109 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fb9750a3-6695-4f02-b26c-2cd743a80b9e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:15.544654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fb9750a3-6695-4f02-b26c-2cd743a80b9e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:15.546982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=28 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:15.551706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb9750a3-6695-4f02-b26c-2cd743a80b9e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:15.552156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb9750a3-6695-4f02-b26c-2cd743a80b9e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:15.552918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb9750a3-6695-4f02-b26c-2cd743a80b9e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:15.553357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb9750a3-6695-4f02-b26c-2cd743a80b9e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:15.617071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fb9750a3-6695-4f02-b26c-2cd743a80b9e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:15.624530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fb9750a3-6695-4f02-b26c-2cd743a80b9e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084368 Jun 02 16:19:15.625101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 584/1151] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:16.642419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d26ac538-886a-4900-ae9c-9389f0d482c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:16.642946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d26ac538-886a-4900-ae9c-9389f0d482c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:16.645472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:16.650234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d26ac538-886a-4900-ae9c-9389f0d482c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:16.650685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d26ac538-886a-4900-ae9c-9389f0d482c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:16.651442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d26ac538-886a-4900-ae9c-9389f0d482c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:16.651879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d26ac538-886a-4900-ae9c-9389f0d482c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:16.713873 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d26ac538-886a-4900-ae9c-9389f0d482c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:16.721598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d26ac538-886a-4900-ae9c-9389f0d482c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082910 Jun 02 16:19:16.722185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 568/1152] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:16 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:17.740072 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9afc5e2c-5557-4c5d-9d4c-7852f95efeea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:17.740673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9afc5e2c-5557-4c5d-9d4c-7852f95efeea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:17.747117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9afc5e2c-5557-4c5d-9d4c-7852f95efeea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:17.747561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9afc5e2c-5557-4c5d-9d4c-7852f95efeea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:17.748319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9afc5e2c-5557-4c5d-9d4c-7852f95efeea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:17.748749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9afc5e2c-5557-4c5d-9d4c-7852f95efeea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:17.751234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:17.812462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9afc5e2c-5557-4c5d-9d4c-7852f95efeea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:17.820341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9afc5e2c-5557-4c5d-9d4c-7852f95efeea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084850 Jun 02 16:19:17.820899 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 585/1153] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:17 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:18.837077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9ea61076-c329-48c5-a01d-5009d06b3d96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:18.837685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9ea61076-c329-48c5-a01d-5009d06b3d96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:18.844306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9ea61076-c329-48c5-a01d-5009d06b3d96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:18.844748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9ea61076-c329-48c5-a01d-5009d06b3d96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:18.845501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9ea61076-c329-48c5-a01d-5009d06b3d96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:18.846242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9ea61076-c329-48c5-a01d-5009d06b3d96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:18.848871 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=90 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:18.911165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9ea61076-c329-48c5-a01d-5009d06b3d96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:18.918913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9ea61076-c329-48c5-a01d-5009d06b3d96 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085645 Jun 02 16:19:18.919478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 569/1154] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:18 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:19.936741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e9786ca3-f592-43a3-92a7-2067defa610d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:19.937359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e9786ca3-f592-43a3-92a7-2067defa610d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:19.944793 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9786ca3-f592-43a3-92a7-2067defa610d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:19.945249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9786ca3-f592-43a3-92a7-2067defa610d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:19.946015 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9786ca3-f592-43a3-92a7-2067defa610d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:19.946483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9786ca3-f592-43a3-92a7-2067defa610d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:20.009410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e9786ca3-f592-43a3-92a7-2067defa610d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:20.016932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e9786ca3-f592-43a3-92a7-2067defa610d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084116 Jun 02 16:19:20.017491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 586/1155] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:21.035012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-614e6400-2dbf-4b14-b696-e2bbe90335b7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:21.036311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-614e6400-2dbf-4b14-b696-e2bbe90335b7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:21.043099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-614e6400-2dbf-4b14-b696-e2bbe90335b7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:21.043552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-614e6400-2dbf-4b14-b696-e2bbe90335b7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:21.044323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-614e6400-2dbf-4b14-b696-e2bbe90335b7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:21.044760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-614e6400-2dbf-4b14-b696-e2bbe90335b7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:21.106640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-614e6400-2dbf-4b14-b696-e2bbe90335b7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:21.114227 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-614e6400-2dbf-4b14-b696-e2bbe90335b7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083029 Jun 02 16:19:21.114804 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 570/1156] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:22.131118 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-97419b42-1b78-420c-bdb6-f19a443ba43a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:22.131772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-97419b42-1b78-420c-bdb6-f19a443ba43a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:22.138418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-97419b42-1b78-420c-bdb6-f19a443ba43a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:22.138875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-97419b42-1b78-420c-bdb6-f19a443ba43a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:22.139637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-97419b42-1b78-420c-bdb6-f19a443ba43a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:22.140078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-97419b42-1b78-420c-bdb6-f19a443ba43a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:22.200494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-97419b42-1b78-420c-bdb6-f19a443ba43a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:22.208104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-97419b42-1b78-420c-bdb6-f19a443ba43a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081036 Jun 02 16:19:22.208663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 587/1157] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:23.225761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-db87ddcb-84ac-45bf-a10c-5a24e6af5e99 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:23.226392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-db87ddcb-84ac-45bf-a10c-5a24e6af5e99 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:23.232883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db87ddcb-84ac-45bf-a10c-5a24e6af5e99 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:23.233327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db87ddcb-84ac-45bf-a10c-5a24e6af5e99 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:23.234091 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db87ddcb-84ac-45bf-a10c-5a24e6af5e99 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:23.234553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-db87ddcb-84ac-45bf-a10c-5a24e6af5e99 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:23.295910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-db87ddcb-84ac-45bf-a10c-5a24e6af5e99 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:23.303465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-db87ddcb-84ac-45bf-a10c-5a24e6af5e99 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082533 Jun 02 16:19:23.304026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 571/1158] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:23 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:24.320157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a0069f08-74c4-4675-b6a2-673406528585 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:24.320761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a0069f08-74c4-4675-b6a2-673406528585 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:24.327241 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a0069f08-74c4-4675-b6a2-673406528585 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:24.327686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a0069f08-74c4-4675-b6a2-673406528585 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:24.328436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a0069f08-74c4-4675-b6a2-673406528585 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:24.328865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a0069f08-74c4-4675-b6a2-673406528585 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:24.389252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a0069f08-74c4-4675-b6a2-673406528585 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:24.396774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a0069f08-74c4-4675-b6a2-673406528585 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080423 Jun 02 16:19:24.397348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 588/1159] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:24 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:25.413700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-29be1de7-dd0b-49d0-912e-564ac6f46415 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:25.414370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-29be1de7-dd0b-49d0-912e-564ac6f46415 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:25.420898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-29be1de7-dd0b-49d0-912e-564ac6f46415 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:25.421347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-29be1de7-dd0b-49d0-912e-564ac6f46415 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:25.422134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-29be1de7-dd0b-49d0-912e-564ac6f46415 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:25.422579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-29be1de7-dd0b-49d0-912e-564ac6f46415 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:25.484676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-29be1de7-dd0b-49d0-912e-564ac6f46415 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:25.493074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-29be1de7-dd0b-49d0-912e-564ac6f46415 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083530 Jun 02 16:19:25.493636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 572/1160] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:25 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:26.510181 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7f10260b-efea-4120-a9f5-b8c84fa0a249 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:26.510796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7f10260b-efea-4120-a9f5-b8c84fa0a249 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:26.517487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7f10260b-efea-4120-a9f5-b8c84fa0a249 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:26.517937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7f10260b-efea-4120-a9f5-b8c84fa0a249 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:26.518826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7f10260b-efea-4120-a9f5-b8c84fa0a249 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:26.519263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7f10260b-efea-4120-a9f5-b8c84fa0a249 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:26.583375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7f10260b-efea-4120-a9f5-b8c84fa0a249 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:26.591481 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7f10260b-efea-4120-a9f5-b8c84fa0a249 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085322 Jun 02 16:19:26.592045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 589/1161] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:26 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:27.607826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7480b5c8-d772-4310-9827-dedb94a289fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:27.608440 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7480b5c8-d772-4310-9827-dedb94a289fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:27.615099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7480b5c8-d772-4310-9827-dedb94a289fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:27.615549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7480b5c8-d772-4310-9827-dedb94a289fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:27.617089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7480b5c8-d772-4310-9827-dedb94a289fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:27.617541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7480b5c8-d772-4310-9827-dedb94a289fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:27.681781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7480b5c8-d772-4310-9827-dedb94a289fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:27.689372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7480b5c8-d772-4310-9827-dedb94a289fc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085512 Jun 02 16:19:27.689985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 573/1162] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:27 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:28.706282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3b604b26-4eca-4c75-8ddf-903a8e4971da tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:28.706905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3b604b26-4eca-4c75-8ddf-903a8e4971da tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:28.713590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b604b26-4eca-4c75-8ddf-903a8e4971da tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:28.714040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b604b26-4eca-4c75-8ddf-903a8e4971da tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:28.714827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b604b26-4eca-4c75-8ddf-903a8e4971da tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:28.715269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b604b26-4eca-4c75-8ddf-903a8e4971da tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:28.779610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3b604b26-4eca-4c75-8ddf-903a8e4971da tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:28.787140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3b604b26-4eca-4c75-8ddf-903a8e4971da tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084749 Jun 02 16:19:28.787704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 590/1163] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:28 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:29.804481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5c33de8d-c3f2-4412-adac-3279ff0d709a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:29.805096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5c33de8d-c3f2-4412-adac-3279ff0d709a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:29.811897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c33de8d-c3f2-4412-adac-3279ff0d709a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:29.812351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c33de8d-c3f2-4412-adac-3279ff0d709a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:29.813113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c33de8d-c3f2-4412-adac-3279ff0d709a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:29.813561 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c33de8d-c3f2-4412-adac-3279ff0d709a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:29.874908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5c33de8d-c3f2-4412-adac-3279ff0d709a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:29.882471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5c33de8d-c3f2-4412-adac-3279ff0d709a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081829 Jun 02 16:19:29.883038 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 574/1164] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:29 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:30.900179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-71951fcb-353a-434d-9bf5-a246079c2e28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:30.900778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-71951fcb-353a-434d-9bf5-a246079c2e28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:30.907263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-71951fcb-353a-434d-9bf5-a246079c2e28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:30.907706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-71951fcb-353a-434d-9bf5-a246079c2e28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:30.908470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-71951fcb-353a-434d-9bf5-a246079c2e28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:30.908897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-71951fcb-353a-434d-9bf5-a246079c2e28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:30.969302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-71951fcb-353a-434d-9bf5-a246079c2e28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:30.977000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-71951fcb-353a-434d-9bf5-a246079c2e28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081195 Jun 02 16:19:30.978459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 591/1165] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:30 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:31.994702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-124cee9a-e8e8-4639-bb20-b6013dcb6974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:31.995376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-124cee9a-e8e8-4639-bb20-b6013dcb6974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:32.002671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-124cee9a-e8e8-4639-bb20-b6013dcb6974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:32.003112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-124cee9a-e8e8-4639-bb20-b6013dcb6974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:32.003871 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-124cee9a-e8e8-4639-bb20-b6013dcb6974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:32.004298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-124cee9a-e8e8-4639-bb20-b6013dcb6974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:32.065695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-124cee9a-e8e8-4639-bb20-b6013dcb6974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:32.073698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-124cee9a-e8e8-4639-bb20-b6013dcb6974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082925 Jun 02 16:19:32.074301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 575/1166] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:31 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:33.090936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9d8a2466-3f0b-44b9-a31e-63f049248392 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:33.103355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9d8a2466-3f0b-44b9-a31e-63f049248392 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:33.103355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d8a2466-3f0b-44b9-a31e-63f049248392 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:33.103355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d8a2466-3f0b-44b9-a31e-63f049248392 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:33.103355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d8a2466-3f0b-44b9-a31e-63f049248392 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:33.103745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d8a2466-3f0b-44b9-a31e-63f049248392 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:33.161087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9d8a2466-3f0b-44b9-a31e-63f049248392 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:33.169075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9d8a2466-3f0b-44b9-a31e-63f049248392 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082297 Jun 02 16:19:33.169652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 592/1167] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:33 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:34.185963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7d2e40de-a54b-4a16-b0e7-758750eeaecb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:34.186614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7d2e40de-a54b-4a16-b0e7-758750eeaecb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:34.193107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d2e40de-a54b-4a16-b0e7-758750eeaecb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:34.193554 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d2e40de-a54b-4a16-b0e7-758750eeaecb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:34.194351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d2e40de-a54b-4a16-b0e7-758750eeaecb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:34.194786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d2e40de-a54b-4a16-b0e7-758750eeaecb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:34.254677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7d2e40de-a54b-4a16-b0e7-758750eeaecb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:34.262704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7d2e40de-a54b-4a16-b0e7-758750eeaecb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080635 Jun 02 16:19:34.263269 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 576/1168] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:34 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:35.279571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-011c0dcd-1e5f-4629-b6f8-670d31a4e548 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:35.280176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-011c0dcd-1e5f-4629-b6f8-670d31a4e548 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:35.286640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-011c0dcd-1e5f-4629-b6f8-670d31a4e548 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:35.287084 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-011c0dcd-1e5f-4629-b6f8-670d31a4e548 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:35.287832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-011c0dcd-1e5f-4629-b6f8-670d31a4e548 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:35.288264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-011c0dcd-1e5f-4629-b6f8-670d31a4e548 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:35.351054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-011c0dcd-1e5f-4629-b6f8-670d31a4e548 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:35.358613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-011c0dcd-1e5f-4629-b6f8-670d31a4e548 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082852 Jun 02 16:19:35.359169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 593/1169] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:35 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:36.375801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2a9c35fc-b313-4a6c-913c-97fe880de0b1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:36.376413 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2a9c35fc-b313-4a6c-913c-97fe880de0b1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:36.382445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2a9c35fc-b313-4a6c-913c-97fe880de0b1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:36.382899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2a9c35fc-b313-4a6c-913c-97fe880de0b1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:36.383659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2a9c35fc-b313-4a6c-913c-97fe880de0b1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:36.384096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2a9c35fc-b313-4a6c-913c-97fe880de0b1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:36.447402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2a9c35fc-b313-4a6c-913c-97fe880de0b1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:36.455540 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2a9c35fc-b313-4a6c-913c-97fe880de0b1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084118 Jun 02 16:19:36.456106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 577/1170] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:36 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:37.472419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2496ec2d-39dd-473d-8074-67a1a0c7d2ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:37.472949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2496ec2d-39dd-473d-8074-67a1a0c7d2ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:37.479586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2496ec2d-39dd-473d-8074-67a1a0c7d2ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:37.480043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2496ec2d-39dd-473d-8074-67a1a0c7d2ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:37.482092 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2496ec2d-39dd-473d-8074-67a1a0c7d2ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:37.482546 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2496ec2d-39dd-473d-8074-67a1a0c7d2ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:37.544504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2496ec2d-39dd-473d-8074-67a1a0c7d2ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:37.552045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2496ec2d-39dd-473d-8074-67a1a0c7d2ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083858 Jun 02 16:19:37.552601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 594/1171] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:37 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:38.569102 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1b14068c-2094-4aaf-92d7-8c7c8dbfdbf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:38.569635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1b14068c-2094-4aaf-92d7-8c7c8dbfdbf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:38.576318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b14068c-2094-4aaf-92d7-8c7c8dbfdbf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:38.576759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b14068c-2094-4aaf-92d7-8c7c8dbfdbf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:38.577544 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b14068c-2094-4aaf-92d7-8c7c8dbfdbf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:38.577976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b14068c-2094-4aaf-92d7-8c7c8dbfdbf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:38.640921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1b14068c-2094-4aaf-92d7-8c7c8dbfdbf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:38.648504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1b14068c-2094-4aaf-92d7-8c7c8dbfdbf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083275 Jun 02 16:19:38.649070 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 578/1172] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:38 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:39.664799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-df2153bc-52fe-48c2-b018-b359e672e695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:39.665352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-df2153bc-52fe-48c2-b018-b359e672e695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:39.672101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df2153bc-52fe-48c2-b018-b359e672e695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:39.672557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df2153bc-52fe-48c2-b018-b359e672e695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:39.673325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df2153bc-52fe-48c2-b018-b359e672e695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:39.673769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df2153bc-52fe-48c2-b018-b359e672e695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:39.735525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-df2153bc-52fe-48c2-b018-b359e672e695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:39.742869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-df2153bc-52fe-48c2-b018-b359e672e695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082100 Jun 02 16:19:39.743430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 595/1173] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:39 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:40.760061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-48ecc3e9-bda1-4d6d-9b33-717f1323e439 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:40.760665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-48ecc3e9-bda1-4d6d-9b33-717f1323e439 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:40.767213 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48ecc3e9-bda1-4d6d-9b33-717f1323e439 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:40.767663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48ecc3e9-bda1-4d6d-9b33-717f1323e439 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:40.768425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48ecc3e9-bda1-4d6d-9b33-717f1323e439 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:40.768861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48ecc3e9-bda1-4d6d-9b33-717f1323e439 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:40.830416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-48ecc3e9-bda1-4d6d-9b33-717f1323e439 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:40.837701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-48ecc3e9-bda1-4d6d-9b33-717f1323e439 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081474 Jun 02 16:19:40.838289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 579/1174] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:40 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:41.037955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6dfc6f3d-69c7-4d7d-a105-e6d9c5d1396f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:41.038982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6dfc6f3d-69c7-4d7d-a105-e6d9c5d1396f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:41.045506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dfc6f3d-69c7-4d7d-a105-e6d9c5d1396f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:41.045957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dfc6f3d-69c7-4d7d-a105-e6d9c5d1396f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:41.046802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dfc6f3d-69c7-4d7d-a105-e6d9c5d1396f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:41.047247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dfc6f3d-69c7-4d7d-a105-e6d9c5d1396f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:41.080829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6dfc6f3d-69c7-4d7d-a105-e6d9c5d1396f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046772 Jun 02 16:19:41.081400 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 596/1175] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jun 2 16:19:41 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:19:41.854845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ce4500e4-40a3-4240-9667-c29dc6007709 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:41.856218 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ce4500e4-40a3-4240-9667-c29dc6007709 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:41.862615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce4500e4-40a3-4240-9667-c29dc6007709 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:41.863063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce4500e4-40a3-4240-9667-c29dc6007709 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:41.863822 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce4500e4-40a3-4240-9667-c29dc6007709 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:41.864254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce4500e4-40a3-4240-9667-c29dc6007709 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:41.925096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ce4500e4-40a3-4240-9667-c29dc6007709 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:41.932537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ce4500e4-40a3-4240-9667-c29dc6007709 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081520 Jun 02 16:19:41.933099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 580/1176] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:41 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:42.615324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-06c90641-4753-42b8-bbfd-ef48e7b5f1fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:42.615779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-06c90641-4753-42b8-bbfd-ef48e7b5f1fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:42.623036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06c90641-4753-42b8-bbfd-ef48e7b5f1fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:42.623480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06c90641-4753-42b8-bbfd-ef48e7b5f1fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:42.624253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06c90641-4753-42b8-bbfd-ef48e7b5f1fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:42.624692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06c90641-4753-42b8-bbfd-ef48e7b5f1fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:42.652475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-06c90641-4753-42b8-bbfd-ef48e7b5f1fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:19:42.910505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-06c90641-4753-42b8-bbfd-ef48e7b5f1fd tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "DELETE /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 204 len: 0 microversion: 2.20 time: 0.298639 Jun 02 16:19:42.911012 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 597/1177] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jun 2 16:19:42 2022] DELETE /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 16:19:42.919770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:42.920511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:42.927002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:42.927440 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:42.928202 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:42.928626 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:42.949332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-11b99a3e-5b6c-43bf-a4ae-27565a0f387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:42.950051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-11b99a3e-5b6c-43bf-a4ae-27565a0f387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:42.956223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11b99a3e-5b6c-43bf-a4ae-27565a0f387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:42.956678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11b99a3e-5b6c-43bf-a4ae-27565a0f387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:42.957447 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11b99a3e-5b6c-43bf-a4ae-27565a0f387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:42.957896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11b99a3e-5b6c-43bf-a4ae-27565a0f387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:43.021834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-11b99a3e-5b6c-43bf-a4ae-27565a0f387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:43.029926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-11b99a3e-5b6c-43bf-a4ae-27565a0f387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084758 Jun 02 16:19:43.030551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 598/1178] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:42 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:19:43.062474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:43.070362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:43.071867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:43.073025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5b5872aa-98d2-4f7c-b077-98c2b29624ed tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.157795 Jun 02 16:19:43.073590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 581/1179] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:19:42 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:19:44.047470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-64df098d-4d18-4b90-b4ce-229d282e4792 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:44.048086 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-64df098d-4d18-4b90-b4ce-229d282e4792 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:44.054673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64df098d-4d18-4b90-b4ce-229d282e4792 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:44.055128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64df098d-4d18-4b90-b4ce-229d282e4792 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:44.055891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64df098d-4d18-4b90-b4ce-229d282e4792 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:44.056331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64df098d-4d18-4b90-b4ce-229d282e4792 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:44.093216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:44.093830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:44.101222 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:44.101671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:44.102465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:44.102898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:44.122843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-64df098d-4d18-4b90-b4ce-229d282e4792 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:44.130502 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-64df098d-4d18-4b90-b4ce-229d282e4792 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087613 Jun 02 16:19:44.131221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 599/1180] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:44 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:44.232252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:44.240267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:44.241781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:44.242972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7e021223-90f1-4ad2-857e-3b0c6441b4ea tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.154224 Jun 02 16:19:44.243550 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 582/1181] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:19:44 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 16:19:45.147357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b4b847da-22b6-43b3-964a-534cea1316bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:45.147999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b4b847da-22b6-43b3-964a-534cea1316bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:45.154573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b4b847da-22b6-43b3-964a-534cea1316bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:45.155029 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b4b847da-22b6-43b3-964a-534cea1316bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:45.155826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b4b847da-22b6-43b3-964a-534cea1316bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:45.156265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b4b847da-22b6-43b3-964a-534cea1316bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:45.160288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:45.225055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b4b847da-22b6-43b3-964a-534cea1316bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:45.233226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b4b847da-22b6-43b3-964a-534cea1316bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.089670 Jun 02 16:19:45.242677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 600/1182] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:45 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:45.260642 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:45.261247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:45.268316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:45.268753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:45.269523 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:45.269953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:45.457965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:45.466600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:45.468136 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:45.469419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-eb87ad44-7749-4b75-abdb-c6ea818b929f tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1725 microversion: 2.20 time: 0.212628 Jun 02 16:19:45.469968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 583/1183] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:19:45 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:19:45.990338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-b4255e9d-8f69-4e11-9dca-301695740b60 req-facbb282-f4c3-4567-9a90-4048c4e943e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942de225-4aff-4a9e-85f0-634ab0ac44e3", "name": "network-vif-deleted", "tag": "97598fb5-567e-4cea-b72c-57887c16e355"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:19:45.993783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:46.001545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-b4255e9d-8f69-4e11-9dca-301695740b60 req-facbb282-f4c3-4567-9a90-4048c4e943e8 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:46.002441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-b4255e9d-8f69-4e11-9dca-301695740b60 req-facbb282-f4c3-4567-9a90-4048c4e943e8 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:46.015387 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-b4255e9d-8f69-4e11-9dca-301695740b60 req-facbb282-f4c3-4567-9a90-4048c4e943e8 service nova] Creating event network-vif-deleted:97598fb5-567e-4cea-b72c-57887c16e355 for instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 on hv-cinder-79760 Jun 02 16:19:46.020749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-b4255e9d-8f69-4e11-9dca-301695740b60 req-facbb282-f4c3-4567-9a90-4048c4e943e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136250 Jun 02 16:19:46.021359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 601/1184] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:19:46.250213 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4802ea7d-fc4c-41b8-94f4-f7ba4b510b68 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:46.250877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4802ea7d-fc4c-41b8-94f4-f7ba4b510b68 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:46.257304 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4802ea7d-fc4c-41b8-94f4-f7ba4b510b68 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:46.257971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4802ea7d-fc4c-41b8-94f4-f7ba4b510b68 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:46.258775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4802ea7d-fc4c-41b8-94f4-f7ba4b510b68 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:46.259216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4802ea7d-fc4c-41b8-94f4-f7ba4b510b68 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:46.323436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4802ea7d-fc4c-41b8-94f4-f7ba4b510b68 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:46.331363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4802ea7d-fc4c-41b8-94f4-f7ba4b510b68 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085737 Jun 02 16:19:46.331968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 584/1185] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:46 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:46.489856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:46.490599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:46.497249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:46.497702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:46.498501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:46.498939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:46.537537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:46.537995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:46.538479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lazy-loading 'fault' on Instance uuid 942de225-4aff-4a9e-85f0-634ab0ac44e3 {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:19:46.582494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:46.591830 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:46.593416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95108cdd8e134be3823d5024f7037b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '470abf75f36f4a84b9382efc2aa2fc1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:46.594613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-af4b18d4-c892-4af5-a870-e1c9e89bb659 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 200 len: 1372 microversion: 2.20 time: 0.110171 Jun 02 16:19:46.595495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 602/1186] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:19:46 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 16:19:47.349223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7ae7a379-4b51-4837-b82b-9cd9c708c4eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:47.349839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7ae7a379-4b51-4837-b82b-9cd9c708c4eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:47.352234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=34 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:47.357242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ae7a379-4b51-4837-b82b-9cd9c708c4eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:47.357689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ae7a379-4b51-4837-b82b-9cd9c708c4eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:47.358483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ae7a379-4b51-4837-b82b-9cd9c708c4eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:47.358924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ae7a379-4b51-4837-b82b-9cd9c708c4eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:47.425247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7ae7a379-4b51-4837-b82b-9cd9c708c4eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:47.427394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:47.434024 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7ae7a379-4b51-4837-b82b-9cd9c708c4eb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.088181 Jun 02 16:19:47.434623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 585/1187] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:47 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:47.614012 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:47.614653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:47.622365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:47.622817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:47.623590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:47.624052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:47.637884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] HTTP exception thrown: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Request method failure captured: Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 HTTP/1.1 Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOBfxS4cclfKx3-RndKo8Dh-CNumTLJ_9ppQhQQxKyMPB4EEBU5GFxYA9-LhBrKjDNTyWY87gQZT1pZartY-1sBtFZIfC7qCMEO9Vkk6hprpWxRiJCu0PbwNFMbxNPkdwvsf8s6P7LrQQqRis9Yox-jWNZMH13qPm6c5jIeo1Wfiw4g Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:19:47.639557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}] Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 95108cdd8e134be3823d5024f7037b3e Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:19:47.641345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '942de225-4aff-4a9e-85f0-634ab0ac44e3'} Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:19:47.642288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:19:47.643825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:19:47.645518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Returning 404 to user: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:19:47.645518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b85647c7-9841-4425-9c11-4ab605bd4e79 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 404 len: 111 microversion: 2.20 time: 0.030803 Jun 02 16:19:47.645518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 603/1188] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:19:47 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:19:47.650116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-71825d53-7f6d-46da-98f8-e143f627ad8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '.version_select at 0x7f2d5c2b7700>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:47.653610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR oslo.messaging._drivers.impl_rabbit [None req-71825d53-7f6d-46da-98f8-e143f627ad8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [8fe11b51-56eb-4b2a-bee7-0847a6d61706] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 16:19:48.451579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-40c5cbe3-4678-4121-a9a5-38d1eb5fe51b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:48.452114 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-40c5cbe3-4678-4121-a9a5-38d1eb5fe51b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:48.458063 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40c5cbe3-4678-4121-a9a5-38d1eb5fe51b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:48.458537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40c5cbe3-4678-4121-a9a5-38d1eb5fe51b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:48.459318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40c5cbe3-4678-4121-a9a5-38d1eb5fe51b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:48.459777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40c5cbe3-4678-4121-a9a5-38d1eb5fe51b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:48.522739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-40c5cbe3-4678-4121-a9a5-38d1eb5fe51b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:48.530708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-40c5cbe3-4678-4121-a9a5-38d1eb5fe51b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083641 Jun 02 16:19:48.531263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 604/1189] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:48 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:19:48.660143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [None req-71825d53-7f6d-46da-98f8-e143f627ad8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [8fe11b51-56eb-4b2a-bee7-0847a6d61706] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 50942. Jun 02 16:19:48.780365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-71825d53-7f6d-46da-98f8-e143f627ad8d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025566890" status: 204 len: 0 microversion: 2.20 time: 1.134294 Jun 02 16:19:48.780876 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 586/1190] 10.222.0.59 () {60 vars in 1261 bytes} [Thu Jun 2 16:19:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025566890 => generated 0 bytes in 1136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 16:19:49.546968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e98c086e-8010-44ef-a85c-d438f3d585ab tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:49.547574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e98c086e-8010-44ef-a85c-d438f3d585ab tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:49.554000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98c086e-8010-44ef-a85c-d438f3d585ab tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:49.554469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98c086e-8010-44ef-a85c-d438f3d585ab tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:49.555222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98c086e-8010-44ef-a85c-d438f3d585ab tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:49.555650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98c086e-8010-44ef-a85c-d438f3d585ab tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:49.620314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e98c086e-8010-44ef-a85c-d438f3d585ab tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:49.628328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e98c086e-8010-44ef-a85c-d438f3d585ab tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085162 Jun 02 16:19:49.628865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 605/1191] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:49 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:50.646537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-75026531-594f-4033-9484-acf1c4c970dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:50.647185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-75026531-594f-4033-9484-acf1c4c970dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:50.654640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-75026531-594f-4033-9484-acf1c4c970dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:50.655089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-75026531-594f-4033-9484-acf1c4c970dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:50.655865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-75026531-594f-4033-9484-acf1c4c970dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:50.656303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-75026531-594f-4033-9484-acf1c4c970dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:50.720855 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-75026531-594f-4033-9484-acf1c4c970dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:50.728614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-75026531-594f-4033-9484-acf1c4c970dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086476 Jun 02 16:19:50.729172 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 587/1192] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:50 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:50.858528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:19:50.859065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:19:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:19:51.744705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-003b80a9-2380-4d57-a403-756cbed4caca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:51.745304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-003b80a9-2380-4d57-a403-756cbed4caca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:51.752630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-003b80a9-2380-4d57-a403-756cbed4caca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:51.753085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-003b80a9-2380-4d57-a403-756cbed4caca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:51.753845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-003b80a9-2380-4d57-a403-756cbed4caca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:51.754312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-003b80a9-2380-4d57-a403-756cbed4caca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:51.815378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-003b80a9-2380-4d57-a403-756cbed4caca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:51.822756 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-003b80a9-2380-4d57-a403-756cbed4caca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081963 Jun 02 16:19:51.823311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 606/1193] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:51 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:52.351677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:19:52.352310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:19:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:19:52.840498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-09d60fa9-5a39-4189-a7d7-4cc89478bcd2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:52.841105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-09d60fa9-5a39-4189-a7d7-4cc89478bcd2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:52.847940 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09d60fa9-5a39-4189-a7d7-4cc89478bcd2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:52.848382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09d60fa9-5a39-4189-a7d7-4cc89478bcd2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:52.849136 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09d60fa9-5a39-4189-a7d7-4cc89478bcd2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:52.849563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09d60fa9-5a39-4189-a7d7-4cc89478bcd2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:52.913004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-09d60fa9-5a39-4189-a7d7-4cc89478bcd2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:52.921148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-09d60fa9-5a39-4189-a7d7-4cc89478bcd2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084547 Jun 02 16:19:52.921711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 588/1194] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:52 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:53.938652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-133e5af9-403e-4098-b361-009ed6a695ed tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:53.939297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-133e5af9-403e-4098-b361-009ed6a695ed tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:53.945962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-133e5af9-403e-4098-b361-009ed6a695ed tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:53.946438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-133e5af9-403e-4098-b361-009ed6a695ed tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:53.947195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-133e5af9-403e-4098-b361-009ed6a695ed tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:53.947627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-133e5af9-403e-4098-b361-009ed6a695ed tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:54.008879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-133e5af9-403e-4098-b361-009ed6a695ed tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:54.017106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-133e5af9-403e-4098-b361-009ed6a695ed tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082368 Jun 02 16:19:54.017664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 607/1195] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:53 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:55.033857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b30c4307-b429-4bcc-8fb0-4ebb6cd95a41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:55.034541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b30c4307-b429-4bcc-8fb0-4ebb6cd95a41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:55.041025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b30c4307-b429-4bcc-8fb0-4ebb6cd95a41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:55.041473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b30c4307-b429-4bcc-8fb0-4ebb6cd95a41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:55.042763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b30c4307-b429-4bcc-8fb0-4ebb6cd95a41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:55.043236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b30c4307-b429-4bcc-8fb0-4ebb6cd95a41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:55.104038 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b30c4307-b429-4bcc-8fb0-4ebb6cd95a41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:55.112325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b30c4307-b429-4bcc-8fb0-4ebb6cd95a41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082347 Jun 02 16:19:55.112890 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 589/1196] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:55 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:56.130043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-90238dd0-7139-46e4-b59f-213fff5db782 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:56.130683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-90238dd0-7139-46e4-b59f-213fff5db782 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:56.137902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-90238dd0-7139-46e4-b59f-213fff5db782 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:56.138392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-90238dd0-7139-46e4-b59f-213fff5db782 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:56.139159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-90238dd0-7139-46e4-b59f-213fff5db782 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:56.139594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-90238dd0-7139-46e4-b59f-213fff5db782 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:56.200192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-90238dd0-7139-46e4-b59f-213fff5db782 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:56.207642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-90238dd0-7139-46e4-b59f-213fff5db782 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081532 Jun 02 16:19:56.208204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 608/1197] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:56 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:57.224938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a0b5b6c4-59d3-46fa-be49-5c716ad25d7e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:57.225542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a0b5b6c4-59d3-46fa-be49-5c716ad25d7e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:57.232221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a0b5b6c4-59d3-46fa-be49-5c716ad25d7e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:57.232664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a0b5b6c4-59d3-46fa-be49-5c716ad25d7e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:57.233417 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a0b5b6c4-59d3-46fa-be49-5c716ad25d7e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:57.233850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a0b5b6c4-59d3-46fa-be49-5c716ad25d7e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:57.294364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a0b5b6c4-59d3-46fa-be49-5c716ad25d7e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:57.301641 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a0b5b6c4-59d3-46fa-be49-5c716ad25d7e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080776 Jun 02 16:19:57.302229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 590/1198] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:57 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:58.318353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-faa498be-fb05-449e-8ab8-6de347ae1798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:58.318971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-faa498be-fb05-449e-8ab8-6de347ae1798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:58.325623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-faa498be-fb05-449e-8ab8-6de347ae1798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:58.326099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-faa498be-fb05-449e-8ab8-6de347ae1798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:58.326863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-faa498be-fb05-449e-8ab8-6de347ae1798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:58.327302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-faa498be-fb05-449e-8ab8-6de347ae1798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:58.390170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-faa498be-fb05-449e-8ab8-6de347ae1798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:58.397602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-faa498be-fb05-449e-8ab8-6de347ae1798 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083104 Jun 02 16:19:58.403132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 609/1199] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:58 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:19:59.415816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c4dc50b6-a83a-4047-a714-fd8e6141f9a8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:19:59.416431 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c4dc50b6-a83a-4047-a714-fd8e6141f9a8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:19:59.423578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4dc50b6-a83a-4047-a714-fd8e6141f9a8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:59.423977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4dc50b6-a83a-4047-a714-fd8e6141f9a8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:59.424742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4dc50b6-a83a-4047-a714-fd8e6141f9a8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:19:59.425183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4dc50b6-a83a-4047-a714-fd8e6141f9a8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:19:59.485832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c4dc50b6-a83a-4047-a714-fd8e6141f9a8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:19:59.493282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c4dc50b6-a83a-4047-a714-fd8e6141f9a8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081373 Jun 02 16:19:59.493853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 591/1200] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:19:59 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:00.514205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6a336800-bc5a-41dc-8aea-6136f7084762 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:00.514753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6a336800-bc5a-41dc-8aea-6136f7084762 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:00.521490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a336800-bc5a-41dc-8aea-6136f7084762 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:00.521932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a336800-bc5a-41dc-8aea-6136f7084762 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:00.522760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a336800-bc5a-41dc-8aea-6136f7084762 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:00.523192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a336800-bc5a-41dc-8aea-6136f7084762 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:00.587239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6a336800-bc5a-41dc-8aea-6136f7084762 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:00.595369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6a336800-bc5a-41dc-8aea-6136f7084762 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.088466 Jun 02 16:20:00.596181 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 610/1201] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:00 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:01.612550 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-563727af-bafa-458d-a4b4-b327c6471936 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:01.613167 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-563727af-bafa-458d-a4b4-b327c6471936 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:01.619579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-563727af-bafa-458d-a4b4-b327c6471936 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:01.620031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-563727af-bafa-458d-a4b4-b327c6471936 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:01.621264 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-563727af-bafa-458d-a4b4-b327c6471936 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:01.621708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-563727af-bafa-458d-a4b4-b327c6471936 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:01.689050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-563727af-bafa-458d-a4b4-b327c6471936 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:01.696617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-563727af-bafa-458d-a4b4-b327c6471936 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.088132 Jun 02 16:20:01.697189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 592/1202] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:01 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:02.715115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ad7e03ab-6bec-49b2-9780-a3e43ce4f97d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:02.715751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ad7e03ab-6bec-49b2-9780-a3e43ce4f97d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:02.722534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ad7e03ab-6bec-49b2-9780-a3e43ce4f97d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:02.723016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ad7e03ab-6bec-49b2-9780-a3e43ce4f97d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:02.724091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ad7e03ab-6bec-49b2-9780-a3e43ce4f97d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:02.724617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ad7e03ab-6bec-49b2-9780-a3e43ce4f97d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:02.785555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ad7e03ab-6bec-49b2-9780-a3e43ce4f97d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:02.793344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ad7e03ab-6bec-49b2-9780-a3e43ce4f97d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083045 Jun 02 16:20:02.793907 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 611/1203] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:02 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:03.809391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a91af2d8-1ef4-4af9-bd9f-d77c5460ea24 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:03.810006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a91af2d8-1ef4-4af9-bd9f-d77c5460ea24 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:03.816653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a91af2d8-1ef4-4af9-bd9f-d77c5460ea24 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:03.817104 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a91af2d8-1ef4-4af9-bd9f-d77c5460ea24 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:03.817869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a91af2d8-1ef4-4af9-bd9f-d77c5460ea24 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:03.818331 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a91af2d8-1ef4-4af9-bd9f-d77c5460ea24 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:03.878416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a91af2d8-1ef4-4af9-bd9f-d77c5460ea24 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:03.886267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a91af2d8-1ef4-4af9-bd9f-d77c5460ea24 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080277 Jun 02 16:20:03.886929 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 593/1204] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:03 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:04.902824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5d172248-f3da-4439-adce-5495a5a223e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:04.903433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5d172248-f3da-4439-adce-5495a5a223e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:04.909929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d172248-f3da-4439-adce-5495a5a223e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:04.910425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d172248-f3da-4439-adce-5495a5a223e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:04.911171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d172248-f3da-4439-adce-5495a5a223e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:04.911608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d172248-f3da-4439-adce-5495a5a223e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:04.972192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5d172248-f3da-4439-adce-5495a5a223e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:04.980169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5d172248-f3da-4439-adce-5495a5a223e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080774 Jun 02 16:20:04.980733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 612/1205] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:04 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:05.997560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-09153fea-8154-42ab-8ff1-eb083ce95bd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:05.998198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-09153fea-8154-42ab-8ff1-eb083ce95bd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:06.004597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09153fea-8154-42ab-8ff1-eb083ce95bd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:06.005049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09153fea-8154-42ab-8ff1-eb083ce95bd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:06.005809 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09153fea-8154-42ab-8ff1-eb083ce95bd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:06.006286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09153fea-8154-42ab-8ff1-eb083ce95bd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:06.068192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-09153fea-8154-42ab-8ff1-eb083ce95bd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:06.076411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-09153fea-8154-42ab-8ff1-eb083ce95bd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083245 Jun 02 16:20:06.077173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 594/1206] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:06.462955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:20:06.463146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:20:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:20:07.093927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3eb16bc1-59e3-4dcf-8837-76d80f7948e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:07.094567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3eb16bc1-59e3-4dcf-8837-76d80f7948e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:07.101275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3eb16bc1-59e3-4dcf-8837-76d80f7948e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:07.101727 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3eb16bc1-59e3-4dcf-8837-76d80f7948e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:07.102518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3eb16bc1-59e3-4dcf-8837-76d80f7948e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:07.102956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3eb16bc1-59e3-4dcf-8837-76d80f7948e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:07.166206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3eb16bc1-59e3-4dcf-8837-76d80f7948e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:07.173849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3eb16bc1-59e3-4dcf-8837-76d80f7948e0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083813 Jun 02 16:20:07.174449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 613/1207] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:07 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:08.190665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cbd6746e-5498-4ea5-bc69-1e1e12310735 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:08.191320 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cbd6746e-5498-4ea5-bc69-1e1e12310735 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:08.197850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cbd6746e-5498-4ea5-bc69-1e1e12310735 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:08.199012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cbd6746e-5498-4ea5-bc69-1e1e12310735 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:08.199790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cbd6746e-5498-4ea5-bc69-1e1e12310735 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:08.200231 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cbd6746e-5498-4ea5-bc69-1e1e12310735 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:08.261817 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cbd6746e-5498-4ea5-bc69-1e1e12310735 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:08.269689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cbd6746e-5498-4ea5-bc69-1e1e12310735 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082831 Jun 02 16:20:08.270278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 595/1208] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:08 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:09.286961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a7876e71-4e8f-459d-baad-0ffa0d9f75e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:09.287568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a7876e71-4e8f-459d-baad-0ffa0d9f75e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:09.294720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7876e71-4e8f-459d-baad-0ffa0d9f75e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:09.295161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7876e71-4e8f-459d-baad-0ffa0d9f75e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:09.295912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7876e71-4e8f-459d-baad-0ffa0d9f75e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:09.296342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7876e71-4e8f-459d-baad-0ffa0d9f75e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:09.357045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a7876e71-4e8f-459d-baad-0ffa0d9f75e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:09.364465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a7876e71-4e8f-459d-baad-0ffa0d9f75e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081342 Jun 02 16:20:09.365023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 614/1209] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:09 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:20:10.381867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-311d775b-b4d7-4d55-9d81-1bd1dbb8b1f0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:10.382439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-311d775b-b4d7-4d55-9d81-1bd1dbb8b1f0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:10.389933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-311d775b-b4d7-4d55-9d81-1bd1dbb8b1f0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:10.390412 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-311d775b-b4d7-4d55-9d81-1bd1dbb8b1f0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:10.391185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-311d775b-b4d7-4d55-9d81-1bd1dbb8b1f0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:10.391626 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-311d775b-b4d7-4d55-9d81-1bd1dbb8b1f0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:10.458281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-311d775b-b4d7-4d55-9d81-1bd1dbb8b1f0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:10.465832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-311d775b-b4d7-4d55-9d81-1bd1dbb8b1f0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087950 Jun 02 16:20:10.466620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 596/1210] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:11.483743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-314cba0e-a6e7-4ca7-b87d-e48ad82c2764 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:11.484284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-314cba0e-a6e7-4ca7-b87d-e48ad82c2764 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:11.490385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-314cba0e-a6e7-4ca7-b87d-e48ad82c2764 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:11.490836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-314cba0e-a6e7-4ca7-b87d-e48ad82c2764 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:11.491579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-314cba0e-a6e7-4ca7-b87d-e48ad82c2764 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:11.492008 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-314cba0e-a6e7-4ca7-b87d-e48ad82c2764 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:11.551330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-314cba0e-a6e7-4ca7-b87d-e48ad82c2764 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:11.559597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-314cba0e-a6e7-4ca7-b87d-e48ad82c2764 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080387 Jun 02 16:20:11.560170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 615/1211] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:12.576131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-59ab694b-47f7-4d3f-87fc-5fe4165c5236 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:12.576688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-59ab694b-47f7-4d3f-87fc-5fe4165c5236 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:12.583336 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59ab694b-47f7-4d3f-87fc-5fe4165c5236 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:12.583762 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59ab694b-47f7-4d3f-87fc-5fe4165c5236 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:12.584517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59ab694b-47f7-4d3f-87fc-5fe4165c5236 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:12.584948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59ab694b-47f7-4d3f-87fc-5fe4165c5236 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:12.645740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-59ab694b-47f7-4d3f-87fc-5fe4165c5236 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:12.653906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-59ab694b-47f7-4d3f-87fc-5fe4165c5236 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081718 Jun 02 16:20:12.654496 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 597/1212] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:13.670519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c2637ea6-e1a8-4df6-86c7-a7b0c16dd60b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:13.671131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c2637ea6-e1a8-4df6-86c7-a7b0c16dd60b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:13.677609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2637ea6-e1a8-4df6-86c7-a7b0c16dd60b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:13.678054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2637ea6-e1a8-4df6-86c7-a7b0c16dd60b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:13.678828 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2637ea6-e1a8-4df6-86c7-a7b0c16dd60b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:13.679264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2637ea6-e1a8-4df6-86c7-a7b0c16dd60b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:13.739669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c2637ea6-e1a8-4df6-86c7-a7b0c16dd60b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:13.749888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c2637ea6-e1a8-4df6-86c7-a7b0c16dd60b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083741 Jun 02 16:20:13.750484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 616/1213] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:13 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:14.766260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1442a27f-b5a3-467e-92dc-aa9800b31e08 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:14.766874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1442a27f-b5a3-467e-92dc-aa9800b31e08 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:14.773460 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1442a27f-b5a3-467e-92dc-aa9800b31e08 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:14.773912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1442a27f-b5a3-467e-92dc-aa9800b31e08 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:14.774714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1442a27f-b5a3-467e-92dc-aa9800b31e08 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:14.775151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1442a27f-b5a3-467e-92dc-aa9800b31e08 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:14.835808 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1442a27f-b5a3-467e-92dc-aa9800b31e08 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:14.843811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1442a27f-b5a3-467e-92dc-aa9800b31e08 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081488 Jun 02 16:20:14.844373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 598/1214] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:15.861871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2018980f-f89a-47df-95a2-99fd82925ae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:15.862534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2018980f-f89a-47df-95a2-99fd82925ae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:15.869064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2018980f-f89a-47df-95a2-99fd82925ae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:15.869516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2018980f-f89a-47df-95a2-99fd82925ae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:15.870312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2018980f-f89a-47df-95a2-99fd82925ae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:15.870755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2018980f-f89a-47df-95a2-99fd82925ae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:15.936378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2018980f-f89a-47df-95a2-99fd82925ae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:15.938611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:20:15.944569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2018980f-f89a-47df-95a2-99fd82925ae7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086568 Jun 02 16:20:15.945135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 617/1215] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:16.962661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4f62986f-7080-4677-8ad1-2586ef9443a3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:16.963280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4f62986f-7080-4677-8ad1-2586ef9443a3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:16.969771 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f62986f-7080-4677-8ad1-2586ef9443a3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:16.970246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f62986f-7080-4677-8ad1-2586ef9443a3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:16.971254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f62986f-7080-4677-8ad1-2586ef9443a3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:16.971685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4f62986f-7080-4677-8ad1-2586ef9443a3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:17.034022 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4f62986f-7080-4677-8ad1-2586ef9443a3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:17.041396 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4f62986f-7080-4677-8ad1-2586ef9443a3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082794 Jun 02 16:20:17.041950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 599/1216] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:16 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:18.059648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c8c5aa92-3a58-4f25-825b-d2fa840d8a7a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:18.060252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c8c5aa92-3a58-4f25-825b-d2fa840d8a7a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:18.062958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=36 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:20:18.067617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8c5aa92-3a58-4f25-825b-d2fa840d8a7a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:18.068060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8c5aa92-3a58-4f25-825b-d2fa840d8a7a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:18.068819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8c5aa92-3a58-4f25-825b-d2fa840d8a7a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:18.069254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8c5aa92-3a58-4f25-825b-d2fa840d8a7a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:18.130728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c8c5aa92-3a58-4f25-825b-d2fa840d8a7a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:18.138750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c8c5aa92-3a58-4f25-825b-d2fa840d8a7a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083649 Jun 02 16:20:18.139318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 618/1217] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:18 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:19.156479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ae118d12-a92b-4c7c-9060-18ffb2df0014 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:19.157083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ae118d12-a92b-4c7c-9060-18ffb2df0014 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:19.159405 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:20:19.164115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ae118d12-a92b-4c7c-9060-18ffb2df0014 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:19.164571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ae118d12-a92b-4c7c-9060-18ffb2df0014 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:19.165333 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ae118d12-a92b-4c7c-9060-18ffb2df0014 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:19.165780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ae118d12-a92b-4c7c-9060-18ffb2df0014 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:19.170194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=80 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:20:19.231525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ae118d12-a92b-4c7c-9060-18ffb2df0014 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:19.239118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ae118d12-a92b-4c7c-9060-18ffb2df0014 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087527 Jun 02 16:20:19.239681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 600/1218] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:20.255797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d113f6f5-4aee-415e-b9eb-436d78883eb6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:20.256401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d113f6f5-4aee-415e-b9eb-436d78883eb6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:20.262979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d113f6f5-4aee-415e-b9eb-436d78883eb6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:20.263428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d113f6f5-4aee-415e-b9eb-436d78883eb6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:20.264174 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d113f6f5-4aee-415e-b9eb-436d78883eb6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:20.264605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d113f6f5-4aee-415e-b9eb-436d78883eb6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:20.325516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d113f6f5-4aee-415e-b9eb-436d78883eb6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:20.333237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d113f6f5-4aee-415e-b9eb-436d78883eb6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081406 Jun 02 16:20:20.333801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 619/1219] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:20 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:21.351426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1317ce30-8b16-4d2a-bfb9-5980dd6b13db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:21.352057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1317ce30-8b16-4d2a-bfb9-5980dd6b13db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:21.359076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1317ce30-8b16-4d2a-bfb9-5980dd6b13db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:21.359516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1317ce30-8b16-4d2a-bfb9-5980dd6b13db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:21.360267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1317ce30-8b16-4d2a-bfb9-5980dd6b13db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:21.360699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1317ce30-8b16-4d2a-bfb9-5980dd6b13db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:21.420927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1317ce30-8b16-4d2a-bfb9-5980dd6b13db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:21.430214 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1317ce30-8b16-4d2a-bfb9-5980dd6b13db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080796 Jun 02 16:20:21.430214 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 601/1220] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:22.445367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3e5de47e-e26a-4ecd-aea5-a86d37aa572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:22.445916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3e5de47e-e26a-4ecd-aea5-a86d37aa572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:22.453019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e5de47e-e26a-4ecd-aea5-a86d37aa572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:22.453468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e5de47e-e26a-4ecd-aea5-a86d37aa572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:22.454267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e5de47e-e26a-4ecd-aea5-a86d37aa572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:22.454705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e5de47e-e26a-4ecd-aea5-a86d37aa572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:22.516108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3e5de47e-e26a-4ecd-aea5-a86d37aa572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:22.523535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3e5de47e-e26a-4ecd-aea5-a86d37aa572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082071 Jun 02 16:20:22.524091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 620/1221] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:23.540590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-56a15fd1-44f9-47d5-8dd4-1d0feefa016d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:23.541135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-56a15fd1-44f9-47d5-8dd4-1d0feefa016d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:23.547663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-56a15fd1-44f9-47d5-8dd4-1d0feefa016d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:23.548109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-56a15fd1-44f9-47d5-8dd4-1d0feefa016d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:23.548872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-56a15fd1-44f9-47d5-8dd4-1d0feefa016d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:23.549310 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-56a15fd1-44f9-47d5-8dd4-1d0feefa016d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:23.610386 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-56a15fd1-44f9-47d5-8dd4-1d0feefa016d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:23.618020 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-56a15fd1-44f9-47d5-8dd4-1d0feefa016d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081456 Jun 02 16:20:23.618611 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 602/1222] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:23 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:24.635745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-78a5a3de-bc06-4c48-ac8f-c97128d387dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:24.637034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-78a5a3de-bc06-4c48-ac8f-c97128d387dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:24.643573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78a5a3de-bc06-4c48-ac8f-c97128d387dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:24.644028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78a5a3de-bc06-4c48-ac8f-c97128d387dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:24.644804 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78a5a3de-bc06-4c48-ac8f-c97128d387dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:24.645240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78a5a3de-bc06-4c48-ac8f-c97128d387dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:24.707595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-78a5a3de-bc06-4c48-ac8f-c97128d387dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:24.715149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-78a5a3de-bc06-4c48-ac8f-c97128d387dd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083200 Jun 02 16:20:24.715643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 621/1223] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:24 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:25.732848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-84bf538a-eddc-44c0-857e-4073a322a21d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:25.733466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-84bf538a-eddc-44c0-857e-4073a322a21d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:25.740279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84bf538a-eddc-44c0-857e-4073a322a21d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:25.740740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84bf538a-eddc-44c0-857e-4073a322a21d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:25.741772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84bf538a-eddc-44c0-857e-4073a322a21d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:25.742243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84bf538a-eddc-44c0-857e-4073a322a21d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:25.804688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-84bf538a-eddc-44c0-857e-4073a322a21d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:25.812311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-84bf538a-eddc-44c0-857e-4073a322a21d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084076 Jun 02 16:20:25.812869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 603/1224] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:25 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:26.829180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-59160c5f-8ca7-4ae1-873c-720fd3182c51 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:26.829780 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-59160c5f-8ca7-4ae1-873c-720fd3182c51 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:26.836196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59160c5f-8ca7-4ae1-873c-720fd3182c51 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:26.836641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59160c5f-8ca7-4ae1-873c-720fd3182c51 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:26.837393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59160c5f-8ca7-4ae1-873c-720fd3182c51 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:26.837822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59160c5f-8ca7-4ae1-873c-720fd3182c51 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:26.898380 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-59160c5f-8ca7-4ae1-873c-720fd3182c51 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:26.906484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-59160c5f-8ca7-4ae1-873c-720fd3182c51 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081128 Jun 02 16:20:26.907042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 622/1225] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:26 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:20:27.923782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-50a29111-a8da-4970-92bd-fd5291285738 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:27.924405 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-50a29111-a8da-4970-92bd-fd5291285738 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:27.930963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50a29111-a8da-4970-92bd-fd5291285738 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:27.931415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50a29111-a8da-4970-92bd-fd5291285738 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:27.932185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50a29111-a8da-4970-92bd-fd5291285738 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:27.932622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50a29111-a8da-4970-92bd-fd5291285738 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:27.996836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-50a29111-a8da-4970-92bd-fd5291285738 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:28.004384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-50a29111-a8da-4970-92bd-fd5291285738 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084554 Jun 02 16:20:28.004948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 604/1226] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:27 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:29.020659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eb0a33aa-0725-43bf-81a5-3e9438e0ccc6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:29.021275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eb0a33aa-0725-43bf-81a5-3e9438e0ccc6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:29.027935 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb0a33aa-0725-43bf-81a5-3e9438e0ccc6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:29.028385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb0a33aa-0725-43bf-81a5-3e9438e0ccc6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:29.029154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb0a33aa-0725-43bf-81a5-3e9438e0ccc6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:29.029594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb0a33aa-0725-43bf-81a5-3e9438e0ccc6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:29.091896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-eb0a33aa-0725-43bf-81a5-3e9438e0ccc6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:29.099587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eb0a33aa-0725-43bf-81a5-3e9438e0ccc6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082764 Jun 02 16:20:29.100148 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 623/1227] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:29 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:30.116629 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-67083230-a2eb-427e-aa82-e19360eba3ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:30.117238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-67083230-a2eb-427e-aa82-e19360eba3ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:30.124091 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67083230-a2eb-427e-aa82-e19360eba3ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:30.124537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67083230-a2eb-427e-aa82-e19360eba3ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:30.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67083230-a2eb-427e-aa82-e19360eba3ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:30.125724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67083230-a2eb-427e-aa82-e19360eba3ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:30.190214 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-67083230-a2eb-427e-aa82-e19360eba3ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:30.197816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-67083230-a2eb-427e-aa82-e19360eba3ec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084967 Jun 02 16:20:30.198421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 605/1228] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:30 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:31.215514 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bbeaf19e-73b8-4aa7-8216-c947fe54269a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:31.216209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bbeaf19e-73b8-4aa7-8216-c947fe54269a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:31.223010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bbeaf19e-73b8-4aa7-8216-c947fe54269a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:31.223457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bbeaf19e-73b8-4aa7-8216-c947fe54269a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:31.224220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bbeaf19e-73b8-4aa7-8216-c947fe54269a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:31.224654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bbeaf19e-73b8-4aa7-8216-c947fe54269a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:31.285833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bbeaf19e-73b8-4aa7-8216-c947fe54269a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:31.294011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bbeaf19e-73b8-4aa7-8216-c947fe54269a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082890 Jun 02 16:20:31.294611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 624/1229] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:31 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:32.311152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b3a3e7a5-2558-467f-9c27-a6fc9bf20ac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:32.311776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b3a3e7a5-2558-467f-9c27-a6fc9bf20ac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:32.318295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3a3e7a5-2558-467f-9c27-a6fc9bf20ac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:32.318753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3a3e7a5-2558-467f-9c27-a6fc9bf20ac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:32.319517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3a3e7a5-2558-467f-9c27-a6fc9bf20ac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:32.319959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3a3e7a5-2558-467f-9c27-a6fc9bf20ac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:32.381653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b3a3e7a5-2558-467f-9c27-a6fc9bf20ac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:32.389323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b3a3e7a5-2558-467f-9c27-a6fc9bf20ac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082624 Jun 02 16:20:32.389880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 606/1230] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:32 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:33.407077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5d9cbbfc-8e77-41f4-b427-dad807b4cf4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:33.407699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5d9cbbfc-8e77-41f4-b427-dad807b4cf4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:33.414430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d9cbbfc-8e77-41f4-b427-dad807b4cf4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:33.414915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d9cbbfc-8e77-41f4-b427-dad807b4cf4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:33.415675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d9cbbfc-8e77-41f4-b427-dad807b4cf4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:33.416113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5d9cbbfc-8e77-41f4-b427-dad807b4cf4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:33.731570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5d9cbbfc-8e77-41f4-b427-dad807b4cf4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:33.739078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5d9cbbfc-8e77-41f4-b427-dad807b4cf4f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.335976 Jun 02 16:20:33.739667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 625/1231] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:33 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:34.757351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-66ab85a1-63cc-433b-8745-5fa591560c65 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:34.757971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-66ab85a1-63cc-433b-8745-5fa591560c65 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:34.765570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-66ab85a1-63cc-433b-8745-5fa591560c65 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:34.766023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-66ab85a1-63cc-433b-8745-5fa591560c65 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:34.766938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-66ab85a1-63cc-433b-8745-5fa591560c65 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:34.767384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-66ab85a1-63cc-433b-8745-5fa591560c65 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:34.830028 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-66ab85a1-63cc-433b-8745-5fa591560c65 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:34.837692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-66ab85a1-63cc-433b-8745-5fa591560c65 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084218 Jun 02 16:20:34.838396 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 607/1232] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:34 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:35.855597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d083cdf2-ae79-4fb6-865f-8ca80596e75d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:35.856209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d083cdf2-ae79-4fb6-865f-8ca80596e75d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:35.863851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d083cdf2-ae79-4fb6-865f-8ca80596e75d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:35.864301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d083cdf2-ae79-4fb6-865f-8ca80596e75d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:35.865062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d083cdf2-ae79-4fb6-865f-8ca80596e75d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:35.865500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d083cdf2-ae79-4fb6-865f-8ca80596e75d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:35.927302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d083cdf2-ae79-4fb6-865f-8ca80596e75d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:35.934850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d083cdf2-ae79-4fb6-865f-8ca80596e75d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083282 Jun 02 16:20:35.935579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 626/1233] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:35 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:36.952279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-30775eb9-b1d5-4ac0-ab6a-f94f1bea108d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:36.952868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-30775eb9-b1d5-4ac0-ab6a-f94f1bea108d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:36.959363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30775eb9-b1d5-4ac0-ab6a-f94f1bea108d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:36.959814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30775eb9-b1d5-4ac0-ab6a-f94f1bea108d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:36.960580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30775eb9-b1d5-4ac0-ab6a-f94f1bea108d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:36.961013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30775eb9-b1d5-4ac0-ab6a-f94f1bea108d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:37.021525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-30775eb9-b1d5-4ac0-ab6a-f94f1bea108d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:37.029677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-30775eb9-b1d5-4ac0-ab6a-f94f1bea108d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081101 Jun 02 16:20:37.030400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 608/1234] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:36 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:38.046277 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-33c9ef90-7e7d-4e98-9a45-10f194bd1554 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:38.046893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-33c9ef90-7e7d-4e98-9a45-10f194bd1554 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:38.053344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33c9ef90-7e7d-4e98-9a45-10f194bd1554 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:38.054776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33c9ef90-7e7d-4e98-9a45-10f194bd1554 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:38.054776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33c9ef90-7e7d-4e98-9a45-10f194bd1554 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:38.055093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33c9ef90-7e7d-4e98-9a45-10f194bd1554 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:38.115409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-33c9ef90-7e7d-4e98-9a45-10f194bd1554 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:38.123278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-33c9ef90-7e7d-4e98-9a45-10f194bd1554 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081094 Jun 02 16:20:38.123951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 627/1235] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:38 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:39.141016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8898a0be-a313-46b7-8572-e74895454223 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:39.141628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8898a0be-a313-46b7-8572-e74895454223 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:39.148161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8898a0be-a313-46b7-8572-e74895454223 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:39.148610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8898a0be-a313-46b7-8572-e74895454223 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:39.149379 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8898a0be-a313-46b7-8572-e74895454223 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:39.149816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8898a0be-a313-46b7-8572-e74895454223 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:39.212817 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8898a0be-a313-46b7-8572-e74895454223 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:39.221251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8898a0be-a313-46b7-8572-e74895454223 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084707 Jun 02 16:20:39.221827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 609/1236] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:39 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:40.238064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6aa6e5db-27be-4e3d-a679-e7fdd49ad4e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:40.238694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6aa6e5db-27be-4e3d-a679-e7fdd49ad4e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:40.244716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5db-27be-4e3d-a679-e7fdd49ad4e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:40.248725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5db-27be-4e3d-a679-e7fdd49ad4e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:40.248725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5db-27be-4e3d-a679-e7fdd49ad4e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:40.248725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5db-27be-4e3d-a679-e7fdd49ad4e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:40.309674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6aa6e5db-27be-4e3d-a679-e7fdd49ad4e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:40.314876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6aa6e5db-27be-4e3d-a679-e7fdd49ad4e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080861 Jun 02 16:20:40.315428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 628/1237] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:40 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:41.332128 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7706706b-53d4-4c01-90cd-1b1c9f541795 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:41.332746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7706706b-53d4-4c01-90cd-1b1c9f541795 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:41.339171 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7706706b-53d4-4c01-90cd-1b1c9f541795 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:41.339616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7706706b-53d4-4c01-90cd-1b1c9f541795 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:41.340372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7706706b-53d4-4c01-90cd-1b1c9f541795 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:41.340810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7706706b-53d4-4c01-90cd-1b1c9f541795 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:41.400623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7706706b-53d4-4c01-90cd-1b1c9f541795 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:41.408060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7706706b-53d4-4c01-90cd-1b1c9f541795 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079884 Jun 02 16:20:41.408628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 610/1238] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:41 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:42.425277 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ad900eee-345c-4476-9cf7-bacc9ebb280d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:42.425895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ad900eee-345c-4476-9cf7-bacc9ebb280d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:42.432408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ad900eee-345c-4476-9cf7-bacc9ebb280d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:42.432886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ad900eee-345c-4476-9cf7-bacc9ebb280d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:42.433660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ad900eee-345c-4476-9cf7-bacc9ebb280d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:42.434113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ad900eee-345c-4476-9cf7-bacc9ebb280d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:42.497180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ad900eee-345c-4476-9cf7-bacc9ebb280d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:42.504723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ad900eee-345c-4476-9cf7-bacc9ebb280d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083319 Jun 02 16:20:42.505284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 629/1239] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:42 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:43.521898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-229f0e10-13b1-419a-aa1a-380adec8387b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:43.522529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-229f0e10-13b1-419a-aa1a-380adec8387b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:43.529243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-229f0e10-13b1-419a-aa1a-380adec8387b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:43.541525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-229f0e10-13b1-419a-aa1a-380adec8387b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:43.541525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-229f0e10-13b1-419a-aa1a-380adec8387b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:43.541525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-229f0e10-13b1-419a-aa1a-380adec8387b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:43.592096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-229f0e10-13b1-419a-aa1a-380adec8387b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:43.599768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-229f0e10-13b1-419a-aa1a-380adec8387b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081858 Jun 02 16:20:43.600328 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 611/1240] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:43 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:44.616721 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-683492b1-f822-4a32-ac22-e97939b85c69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:44.617334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-683492b1-f822-4a32-ac22-e97939b85c69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:44.624213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-683492b1-f822-4a32-ac22-e97939b85c69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:44.624671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-683492b1-f822-4a32-ac22-e97939b85c69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:44.625441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-683492b1-f822-4a32-ac22-e97939b85c69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:44.625879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-683492b1-f822-4a32-ac22-e97939b85c69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:44.692014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-683492b1-f822-4a32-ac22-e97939b85c69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:44.699532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-683492b1-f822-4a32-ac22-e97939b85c69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086809 Jun 02 16:20:44.700098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 630/1241] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:44 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:45.718329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b77bc6bf-2b13-4433-ba59-3b5dccc66a3f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:45.718985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b77bc6bf-2b13-4433-ba59-3b5dccc66a3f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:45.725826 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b77bc6bf-2b13-4433-ba59-3b5dccc66a3f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:45.726315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b77bc6bf-2b13-4433-ba59-3b5dccc66a3f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:45.730023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b77bc6bf-2b13-4433-ba59-3b5dccc66a3f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:45.730023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b77bc6bf-2b13-4433-ba59-3b5dccc66a3f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:45.790781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b77bc6bf-2b13-4433-ba59-3b5dccc66a3f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:45.799347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b77bc6bf-2b13-4433-ba59-3b5dccc66a3f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086004 Jun 02 16:20:45.799906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 612/1242] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:45 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:46.816633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d9909c91-412b-4018-876d-ccfbb43080d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:46.817224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d9909c91-412b-4018-876d-ccfbb43080d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:46.823678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9909c91-412b-4018-876d-ccfbb43080d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:46.824129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9909c91-412b-4018-876d-ccfbb43080d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:46.824882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9909c91-412b-4018-876d-ccfbb43080d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:46.825837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9909c91-412b-4018-876d-ccfbb43080d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:46.886540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d9909c91-412b-4018-876d-ccfbb43080d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:46.894380 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d9909c91-412b-4018-876d-ccfbb43080d2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081609 Jun 02 16:20:46.894945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 631/1243] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:46 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:47.911775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-22448608-3c83-47bd-a4cb-0a77df9252e5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:47.912389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-22448608-3c83-47bd-a4cb-0a77df9252e5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:47.918792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22448608-3c83-47bd-a4cb-0a77df9252e5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:47.919244 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22448608-3c83-47bd-a4cb-0a77df9252e5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:47.920694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22448608-3c83-47bd-a4cb-0a77df9252e5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:47.921132 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22448608-3c83-47bd-a4cb-0a77df9252e5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:47.986261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-22448608-3c83-47bd-a4cb-0a77df9252e5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:47.994761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-22448608-3c83-47bd-a4cb-0a77df9252e5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086823 Jun 02 16:20:47.995435 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 613/1244] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:47 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:49.012816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-94239c12-0db2-41f2-8818-6789e484867a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:49.013545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-94239c12-0db2-41f2-8818-6789e484867a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:49.019986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-94239c12-0db2-41f2-8818-6789e484867a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:49.020428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-94239c12-0db2-41f2-8818-6789e484867a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:49.021185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-94239c12-0db2-41f2-8818-6789e484867a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:49.021612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-94239c12-0db2-41f2-8818-6789e484867a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:49.024173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=86 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:20:49.083887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-94239c12-0db2-41f2-8818-6789e484867a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:49.091259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-94239c12-0db2-41f2-8818-6789e484867a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082426 Jun 02 16:20:49.092398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 632/1245] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:49 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:50.108956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c95b75e8-0bae-4a8f-9054-929276383bc1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:50.109558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c95b75e8-0bae-4a8f-9054-929276383bc1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:50.116302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c95b75e8-0bae-4a8f-9054-929276383bc1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:50.116759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c95b75e8-0bae-4a8f-9054-929276383bc1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:50.117532 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c95b75e8-0bae-4a8f-9054-929276383bc1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:50.117975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c95b75e8-0bae-4a8f-9054-929276383bc1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:50.121995 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=84 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:20:50.179989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c95b75e8-0bae-4a8f-9054-929276383bc1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:50.188412 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c95b75e8-0bae-4a8f-9054-929276383bc1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083380 Jun 02 16:20:50.193805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 614/1246] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:50 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:51.206363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e0cdcfb8-a582-4c3b-9534-7643fe21d857 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:51.206903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e0cdcfb8-a582-4c3b-9534-7643fe21d857 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:51.209238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=30 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:20:51.214025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0cdcfb8-a582-4c3b-9534-7643fe21d857 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:51.219534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0cdcfb8-a582-4c3b-9534-7643fe21d857 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:51.219534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0cdcfb8-a582-4c3b-9534-7643fe21d857 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:51.219534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0cdcfb8-a582-4c3b-9534-7643fe21d857 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:51.281865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e0cdcfb8-a582-4c3b-9534-7643fe21d857 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:51.289358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e0cdcfb8-a582-4c3b-9534-7643fe21d857 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087119 Jun 02 16:20:51.289940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 633/1247] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:51 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:52.305816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8aab5d9e-251c-46ad-b2a5-7f8d91ef0e9d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:52.306445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8aab5d9e-251c-46ad-b2a5-7f8d91ef0e9d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:52.308678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=30 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:20:52.314340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8aab5d9e-251c-46ad-b2a5-7f8d91ef0e9d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:52.314783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8aab5d9e-251c-46ad-b2a5-7f8d91ef0e9d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:52.315533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8aab5d9e-251c-46ad-b2a5-7f8d91ef0e9d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:52.315964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8aab5d9e-251c-46ad-b2a5-7f8d91ef0e9d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:52.376632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8aab5d9e-251c-46ad-b2a5-7f8d91ef0e9d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:52.383998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8aab5d9e-251c-46ad-b2a5-7f8d91ef0e9d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082326 Jun 02 16:20:52.384557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 615/1248] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:52 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:53.401783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-87937ede-9502-4970-a364-0ed4aba482e6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:53.402419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-87937ede-9502-4970-a364-0ed4aba482e6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:53.409831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87937ede-9502-4970-a364-0ed4aba482e6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:53.410321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87937ede-9502-4970-a364-0ed4aba482e6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:53.411091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87937ede-9502-4970-a364-0ed4aba482e6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:53.411534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87937ede-9502-4970-a364-0ed4aba482e6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:53.472279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-87937ede-9502-4970-a364-0ed4aba482e6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:53.479658 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-87937ede-9502-4970-a364-0ed4aba482e6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081709 Jun 02 16:20:53.480226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 634/1249] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:53 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:54.496576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-22e54adc-1483-4e71-bef0-bd35df013517 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:54.497216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-22e54adc-1483-4e71-bef0-bd35df013517 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:54.504255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22e54adc-1483-4e71-bef0-bd35df013517 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:54.504707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22e54adc-1483-4e71-bef0-bd35df013517 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:54.505474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22e54adc-1483-4e71-bef0-bd35df013517 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:54.505914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22e54adc-1483-4e71-bef0-bd35df013517 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:54.567977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-22e54adc-1483-4e71-bef0-bd35df013517 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:54.575664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-22e54adc-1483-4e71-bef0-bd35df013517 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083082 Jun 02 16:20:54.576565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 616/1250] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:54 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:20:55.593360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ef7c15ed-916b-483a-adf9-ae783970f877 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:55.593915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ef7c15ed-916b-483a-adf9-ae783970f877 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:55.600707 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef7c15ed-916b-483a-adf9-ae783970f877 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:55.601163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef7c15ed-916b-483a-adf9-ae783970f877 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:55.601932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef7c15ed-916b-483a-adf9-ae783970f877 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:55.602398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef7c15ed-916b-483a-adf9-ae783970f877 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:55.662384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ef7c15ed-916b-483a-adf9-ae783970f877 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:55.670245 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ef7c15ed-916b-483a-adf9-ae783970f877 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081300 Jun 02 16:20:55.670818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 635/1251] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:55 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:56.687987 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-41ba2618-731b-4680-a07e-3681bec7eb21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:56.688606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-41ba2618-731b-4680-a07e-3681bec7eb21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:56.695201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ba2618-731b-4680-a07e-3681bec7eb21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:56.695652 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ba2618-731b-4680-a07e-3681bec7eb21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:56.696423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ba2618-731b-4680-a07e-3681bec7eb21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:56.696861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ba2618-731b-4680-a07e-3681bec7eb21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:56.762499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-41ba2618-731b-4680-a07e-3681bec7eb21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:56.770115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-41ba2618-731b-4680-a07e-3681bec7eb21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086998 Jun 02 16:20:56.770681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 617/1252] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:56 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:57.787534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8f25699c-7626-444e-abed-7086bf60ac77 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:57.788152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8f25699c-7626-444e-abed-7086bf60ac77 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:57.794830 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f25699c-7626-444e-abed-7086bf60ac77 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:57.795282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f25699c-7626-444e-abed-7086bf60ac77 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:57.796048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f25699c-7626-444e-abed-7086bf60ac77 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:57.796488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f25699c-7626-444e-abed-7086bf60ac77 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:57.857059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8f25699c-7626-444e-abed-7086bf60ac77 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:57.864524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8f25699c-7626-444e-abed-7086bf60ac77 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080956 Jun 02 16:20:57.865116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 636/1253] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:57 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:20:58.881433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-294a6b06-1258-4694-8bf2-98c4efc9387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:20:58.882050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-294a6b06-1258-4694-8bf2-98c4efc9387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:20:58.888694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-294a6b06-1258-4694-8bf2-98c4efc9387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:58.889142 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-294a6b06-1258-4694-8bf2-98c4efc9387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:58.889911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-294a6b06-1258-4694-8bf2-98c4efc9387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:20:58.890380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-294a6b06-1258-4694-8bf2-98c4efc9387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:20:59.202150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-294a6b06-1258-4694-8bf2-98c4efc9387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:20:59.209576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-294a6b06-1258-4694-8bf2-98c4efc9387d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.332020 Jun 02 16:20:59.210155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 618/1254] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:20:58 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:00.230130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7f2cd601-c38c-4977-a7cd-336fdb86a186 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:00.230740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7f2cd601-c38c-4977-a7cd-336fdb86a186 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:00.237209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7f2cd601-c38c-4977-a7cd-336fdb86a186 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:00.237663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7f2cd601-c38c-4977-a7cd-336fdb86a186 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:00.238451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7f2cd601-c38c-4977-a7cd-336fdb86a186 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:00.238894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7f2cd601-c38c-4977-a7cd-336fdb86a186 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:00.304971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7f2cd601-c38c-4977-a7cd-336fdb86a186 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:00.313640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7f2cd601-c38c-4977-a7cd-336fdb86a186 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.090077 Jun 02 16:21:00.314239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 637/1255] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:00 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:01.332356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5997139d-d073-4aaf-8e1c-c9bcfeeffe72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:01.332948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5997139d-d073-4aaf-8e1c-c9bcfeeffe72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:01.340117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5997139d-d073-4aaf-8e1c-c9bcfeeffe72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:01.340706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5997139d-d073-4aaf-8e1c-c9bcfeeffe72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:01.342026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5997139d-d073-4aaf-8e1c-c9bcfeeffe72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:01.342467 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5997139d-d073-4aaf-8e1c-c9bcfeeffe72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:01.408115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5997139d-d073-4aaf-8e1c-c9bcfeeffe72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:01.415642 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5997139d-d073-4aaf-8e1c-c9bcfeeffe72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087611 Jun 02 16:21:01.416201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 619/1256] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:01 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:02.432736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-af6fe5b8-f0d8-494d-8191-ff7b98fae33e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:02.433287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-af6fe5b8-f0d8-494d-8191-ff7b98fae33e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:02.440170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af6fe5b8-f0d8-494d-8191-ff7b98fae33e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:02.440641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af6fe5b8-f0d8-494d-8191-ff7b98fae33e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:02.441409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af6fe5b8-f0d8-494d-8191-ff7b98fae33e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:02.441849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-af6fe5b8-f0d8-494d-8191-ff7b98fae33e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:02.504990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-af6fe5b8-f0d8-494d-8191-ff7b98fae33e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:02.512412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-af6fe5b8-f0d8-494d-8191-ff7b98fae33e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083591 Jun 02 16:21:02.513579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 638/1257] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:02 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:03.530723 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a71a2665-5e74-4b22-94b6-b1a9e5719730 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:03.531292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a71a2665-5e74-4b22-94b6-b1a9e5719730 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:03.538558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a71a2665-5e74-4b22-94b6-b1a9e5719730 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:03.539013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a71a2665-5e74-4b22-94b6-b1a9e5719730 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:03.539780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a71a2665-5e74-4b22-94b6-b1a9e5719730 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:03.540216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a71a2665-5e74-4b22-94b6-b1a9e5719730 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:03.601515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a71a2665-5e74-4b22-94b6-b1a9e5719730 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:03.610025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a71a2665-5e74-4b22-94b6-b1a9e5719730 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083965 Jun 02 16:21:03.610627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 620/1258] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:03 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:04.628107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b1e9e898-0d85-4ca9-810a-57f42d57171a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:04.628693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b1e9e898-0d85-4ca9-810a-57f42d57171a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:04.635077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1e9e898-0d85-4ca9-810a-57f42d57171a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:04.635531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1e9e898-0d85-4ca9-810a-57f42d57171a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:04.636296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1e9e898-0d85-4ca9-810a-57f42d57171a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:04.636737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1e9e898-0d85-4ca9-810a-57f42d57171a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:04.703106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b1e9e898-0d85-4ca9-810a-57f42d57171a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:04.710558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b1e9e898-0d85-4ca9-810a-57f42d57171a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086444 Jun 02 16:21:04.711126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 639/1259] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:04 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:05.728247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-68610a33-4612-4e3f-979c-16645206fcec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:05.728895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-68610a33-4612-4e3f-979c-16645206fcec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:05.736679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-68610a33-4612-4e3f-979c-16645206fcec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:05.737130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-68610a33-4612-4e3f-979c-16645206fcec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:05.737899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-68610a33-4612-4e3f-979c-16645206fcec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:05.738377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-68610a33-4612-4e3f-979c-16645206fcec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:05.799093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-68610a33-4612-4e3f-979c-16645206fcec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:05.806617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-68610a33-4612-4e3f-979c-16645206fcec tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082355 Jun 02 16:21:05.807189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 621/1260] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:06.822846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d76be028-2a10-4028-90af-4f7777f9fce2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:06.823458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d76be028-2a10-4028-90af-4f7777f9fce2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:06.830062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d76be028-2a10-4028-90af-4f7777f9fce2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:06.830537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d76be028-2a10-4028-90af-4f7777f9fce2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:06.831296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d76be028-2a10-4028-90af-4f7777f9fce2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:06.831731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d76be028-2a10-4028-90af-4f7777f9fce2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:06.893801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d76be028-2a10-4028-90af-4f7777f9fce2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:06.901265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d76be028-2a10-4028-90af-4f7777f9fce2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082250 Jun 02 16:21:06.901826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 640/1261] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:06 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:07.918003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d2aa6e7c-fa06-4e05-a131-dc96173cc679 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:07.918571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d2aa6e7c-fa06-4e05-a131-dc96173cc679 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:07.925017 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2aa6e7c-fa06-4e05-a131-dc96173cc679 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:07.925472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2aa6e7c-fa06-4e05-a131-dc96173cc679 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:07.926284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2aa6e7c-fa06-4e05-a131-dc96173cc679 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:07.926725 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2aa6e7c-fa06-4e05-a131-dc96173cc679 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:07.989863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d2aa6e7c-fa06-4e05-a131-dc96173cc679 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:07.997358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d2aa6e7c-fa06-4e05-a131-dc96173cc679 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083246 Jun 02 16:21:07.998450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 622/1262] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:07 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:09.014958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2d6ce143-174a-47bf-865a-058bbe9e0bfb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:09.015507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2d6ce143-174a-47bf-865a-058bbe9e0bfb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:09.021976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d6ce143-174a-47bf-865a-058bbe9e0bfb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:09.022457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d6ce143-174a-47bf-865a-058bbe9e0bfb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:09.023248 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d6ce143-174a-47bf-865a-058bbe9e0bfb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:09.023685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d6ce143-174a-47bf-865a-058bbe9e0bfb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:09.087766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2d6ce143-174a-47bf-865a-058bbe9e0bfb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:09.095207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2d6ce143-174a-47bf-865a-058bbe9e0bfb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084446 Jun 02 16:21:09.095762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 641/1263] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:09 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:10.112232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-816a77ad-4418-442c-bab9-38287aebf1cf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:10.112844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-816a77ad-4418-442c-bab9-38287aebf1cf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:10.119403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-816a77ad-4418-442c-bab9-38287aebf1cf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:10.119857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-816a77ad-4418-442c-bab9-38287aebf1cf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:10.120627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-816a77ad-4418-442c-bab9-38287aebf1cf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:10.121067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-816a77ad-4418-442c-bab9-38287aebf1cf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:10.183433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-816a77ad-4418-442c-bab9-38287aebf1cf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:10.191686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-816a77ad-4418-442c-bab9-38287aebf1cf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083274 Jun 02 16:21:10.192252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 623/1264] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:21:11.208655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-83bb0271-40a6-4e1d-a670-a04cd252bdea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:11.209325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-83bb0271-40a6-4e1d-a670-a04cd252bdea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:11.215517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83bb0271-40a6-4e1d-a670-a04cd252bdea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:11.215968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83bb0271-40a6-4e1d-a670-a04cd252bdea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:11.217333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83bb0271-40a6-4e1d-a670-a04cd252bdea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:11.217764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83bb0271-40a6-4e1d-a670-a04cd252bdea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:11.277617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-83bb0271-40a6-4e1d-a670-a04cd252bdea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:11.285751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-83bb0271-40a6-4e1d-a670-a04cd252bdea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080972 Jun 02 16:21:11.286327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 642/1265] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:12.302970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7b9f4c4b-ab25-4245-a9e7-8768566f5183 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:12.303591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7b9f4c4b-ab25-4245-a9e7-8768566f5183 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:12.310900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b9f4c4b-ab25-4245-a9e7-8768566f5183 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:12.311414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b9f4c4b-ab25-4245-a9e7-8768566f5183 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:12.312180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b9f4c4b-ab25-4245-a9e7-8768566f5183 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:12.312622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b9f4c4b-ab25-4245-a9e7-8768566f5183 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:12.372279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7b9f4c4b-ab25-4245-a9e7-8768566f5183 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:12.380506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7b9f4c4b-ab25-4245-a9e7-8768566f5183 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081397 Jun 02 16:21:12.381075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 624/1266] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:13.397511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f38b6bbc-726c-4fba-b821-5635fde92a8f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:13.398139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f38b6bbc-726c-4fba-b821-5635fde92a8f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:13.405643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f38b6bbc-726c-4fba-b821-5635fde92a8f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:13.406204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f38b6bbc-726c-4fba-b821-5635fde92a8f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:13.406969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f38b6bbc-726c-4fba-b821-5635fde92a8f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:13.407397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f38b6bbc-726c-4fba-b821-5635fde92a8f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:13.468589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f38b6bbc-726c-4fba-b821-5635fde92a8f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:13.476364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f38b6bbc-726c-4fba-b821-5635fde92a8f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082735 Jun 02 16:21:13.476935 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 643/1267] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:13 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:14.494042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-38d0e434-14be-456d-be73-c78a6b544b3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:14.494635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-38d0e434-14be-456d-be73-c78a6b544b3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:14.501674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38d0e434-14be-456d-be73-c78a6b544b3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:14.502145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38d0e434-14be-456d-be73-c78a6b544b3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:14.502904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38d0e434-14be-456d-be73-c78a6b544b3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:14.503338 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38d0e434-14be-456d-be73-c78a6b544b3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:14.565416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-38d0e434-14be-456d-be73-c78a6b544b3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:14.572810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-38d0e434-14be-456d-be73-c78a6b544b3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082655 Jun 02 16:21:14.573361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 625/1268] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:15.589905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-04044883-6b19-4abf-bd89-c03647c793c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:15.590481 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-04044883-6b19-4abf-bd89-c03647c793c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:15.597752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04044883-6b19-4abf-bd89-c03647c793c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:15.598250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04044883-6b19-4abf-bd89-c03647c793c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:15.599026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04044883-6b19-4abf-bd89-c03647c793c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:15.599467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04044883-6b19-4abf-bd89-c03647c793c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:15.662396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-04044883-6b19-4abf-bd89-c03647c793c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:15.670831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-04044883-6b19-4abf-bd89-c03647c793c9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084893 Jun 02 16:21:15.671396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 644/1269] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:16.687848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8328f404-4449-43b1-8b67-efa06a63262b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:16.688463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8328f404-4449-43b1-8b67-efa06a63262b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:16.694451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8328f404-4449-43b1-8b67-efa06a63262b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:16.694894 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8328f404-4449-43b1-8b67-efa06a63262b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:16.695649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8328f404-4449-43b1-8b67-efa06a63262b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:16.696079 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8328f404-4449-43b1-8b67-efa06a63262b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:16.759951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8328f404-4449-43b1-8b67-efa06a63262b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:16.767945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8328f404-4449-43b1-8b67-efa06a63262b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084037 Jun 02 16:21:16.768513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 626/1270] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:16 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:17.785730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0a279da2-2347-46b2-a8c2-a0b1433c8ff3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:17.786373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0a279da2-2347-46b2-a8c2-a0b1433c8ff3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:17.792786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a279da2-2347-46b2-a8c2-a0b1433c8ff3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:17.793237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a279da2-2347-46b2-a8c2-a0b1433c8ff3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:17.794016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a279da2-2347-46b2-a8c2-a0b1433c8ff3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:17.794741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a279da2-2347-46b2-a8c2-a0b1433c8ff3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:17.858668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0a279da2-2347-46b2-a8c2-a0b1433c8ff3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:17.866101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0a279da2-2347-46b2-a8c2-a0b1433c8ff3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084304 Jun 02 16:21:17.866686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 645/1271] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:17 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:18.883241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a9a72fd1-8201-4bd3-80c8-3863cd0c8b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:18.883888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a9a72fd1-8201-4bd3-80c8-3863cd0c8b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:18.891198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9a72fd1-8201-4bd3-80c8-3863cd0c8b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:18.891646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9a72fd1-8201-4bd3-80c8-3863cd0c8b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:18.892410 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9a72fd1-8201-4bd3-80c8-3863cd0c8b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:18.892852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9a72fd1-8201-4bd3-80c8-3863cd0c8b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:18.955465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a9a72fd1-8201-4bd3-80c8-3863cd0c8b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:18.963008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a9a72fd1-8201-4bd3-80c8-3863cd0c8b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083622 Jun 02 16:21:18.963580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 627/1272] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:18 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:19.980699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-63958b09-37ba-4b74-8d48-3b6ade7b9746 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:19.981315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-63958b09-37ba-4b74-8d48-3b6ade7b9746 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:19.988388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63958b09-37ba-4b74-8d48-3b6ade7b9746 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:19.988842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63958b09-37ba-4b74-8d48-3b6ade7b9746 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:19.989607 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63958b09-37ba-4b74-8d48-3b6ade7b9746 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:19.990054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63958b09-37ba-4b74-8d48-3b6ade7b9746 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:19.993905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:20.051556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-63958b09-37ba-4b74-8d48-3b6ade7b9746 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:20.059081 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-63958b09-37ba-4b74-8d48-3b6ade7b9746 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082274 Jun 02 16:21:20.059704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 646/1273] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:21.077210 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-35d83838-0b0a-4174-bb1a-481f4ae0d15d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:21.077851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-35d83838-0b0a-4174-bb1a-481f4ae0d15d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:21.084591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-35d83838-0b0a-4174-bb1a-481f4ae0d15d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:21.085047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-35d83838-0b0a-4174-bb1a-481f4ae0d15d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:21.085821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-35d83838-0b0a-4174-bb1a-481f4ae0d15d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:21.086298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-35d83838-0b0a-4174-bb1a-481f4ae0d15d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:21.149721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-35d83838-0b0a-4174-bb1a-481f4ae0d15d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:21.157964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-35d83838-0b0a-4174-bb1a-481f4ae0d15d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085160 Jun 02 16:21:21.159034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 628/1274] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:22.175079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d27d1d06-8fce-4c2a-86ee-8a484ac6c8ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:22.175696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d27d1d06-8fce-4c2a-86ee-8a484ac6c8ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:22.177987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=28 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:22.182718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d27d1d06-8fce-4c2a-86ee-8a484ac6c8ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:22.183169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d27d1d06-8fce-4c2a-86ee-8a484ac6c8ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:22.183940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d27d1d06-8fce-4c2a-86ee-8a484ac6c8ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:22.184379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d27d1d06-8fce-4c2a-86ee-8a484ac6c8ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:22.245673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d27d1d06-8fce-4c2a-86ee-8a484ac6c8ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:22.253289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d27d1d06-8fce-4c2a-86ee-8a484ac6c8ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082141 Jun 02 16:21:22.253841 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 647/1275] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:21:23.270170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c812ad97-19fa-4bf7-8c7c-effce1d8ac7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:23.270791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c812ad97-19fa-4bf7-8c7c-effce1d8ac7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:23.273111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:23.277851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c812ad97-19fa-4bf7-8c7c-effce1d8ac7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:23.278334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c812ad97-19fa-4bf7-8c7c-effce1d8ac7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:23.279108 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c812ad97-19fa-4bf7-8c7c-effce1d8ac7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:23.280185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c812ad97-19fa-4bf7-8c7c-effce1d8ac7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:23.282933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=90 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:23.341165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c812ad97-19fa-4bf7-8c7c-effce1d8ac7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:23.350693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c812ad97-19fa-4bf7-8c7c-effce1d8ac7b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084358 Jun 02 16:21:23.351265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 629/1276] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:23 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:24.368125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f12c1eb7-5526-4b61-ac9c-b9a9cec7993c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:24.368768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f12c1eb7-5526-4b61-ac9c-b9a9cec7993c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:24.375933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f12c1eb7-5526-4b61-ac9c-b9a9cec7993c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:24.376377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f12c1eb7-5526-4b61-ac9c-b9a9cec7993c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:24.377130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f12c1eb7-5526-4b61-ac9c-b9a9cec7993c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:24.377564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f12c1eb7-5526-4b61-ac9c-b9a9cec7993c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:24.441255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f12c1eb7-5526-4b61-ac9c-b9a9cec7993c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:24.448775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f12c1eb7-5526-4b61-ac9c-b9a9cec7993c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084511 Jun 02 16:21:24.455338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 648/1277] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:24 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:25.464962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8eb7357c-f0f4-4c8d-bed7-8b70490f277b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:25.465601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8eb7357c-f0f4-4c8d-bed7-8b70490f277b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:25.473113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8eb7357c-f0f4-4c8d-bed7-8b70490f277b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:25.473570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8eb7357c-f0f4-4c8d-bed7-8b70490f277b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:25.474369 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8eb7357c-f0f4-4c8d-bed7-8b70490f277b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:25.474847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8eb7357c-f0f4-4c8d-bed7-8b70490f277b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:25.537722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8eb7357c-f0f4-4c8d-bed7-8b70490f277b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:25.545256 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8eb7357c-f0f4-4c8d-bed7-8b70490f277b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084441 Jun 02 16:21:25.545821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 630/1278] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:25 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:26.562565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c2c00808-14bf-4010-8093-c22c8aad5391 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:26.563214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c2c00808-14bf-4010-8093-c22c8aad5391 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:26.569672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2c00808-14bf-4010-8093-c22c8aad5391 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:26.570167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2c00808-14bf-4010-8093-c22c8aad5391 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:26.570934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2c00808-14bf-4010-8093-c22c8aad5391 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:26.571377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2c00808-14bf-4010-8093-c22c8aad5391 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:26.636822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c2c00808-14bf-4010-8093-c22c8aad5391 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:26.645124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c2c00808-14bf-4010-8093-c22c8aad5391 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086912 Jun 02 16:21:26.645686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 649/1279] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:26 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:27.662538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-846cffd6-0483-4a2c-ae07-db3209837691 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:27.663178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-846cffd6-0483-4a2c-ae07-db3209837691 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:27.670224 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-846cffd6-0483-4a2c-ae07-db3209837691 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:27.671045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-846cffd6-0483-4a2c-ae07-db3209837691 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:27.671838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-846cffd6-0483-4a2c-ae07-db3209837691 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:27.672284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-846cffd6-0483-4a2c-ae07-db3209837691 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:27.734473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-846cffd6-0483-4a2c-ae07-db3209837691 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:27.741827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-846cffd6-0483-4a2c-ae07-db3209837691 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083174 Jun 02 16:21:27.742509 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 631/1280] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:27 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:28.759791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4a0fe301-06bc-43a7-9314-d01157954e27 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:28.760335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4a0fe301-06bc-43a7-9314-d01157954e27 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:28.767751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a0fe301-06bc-43a7-9314-d01157954e27 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:28.768198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a0fe301-06bc-43a7-9314-d01157954e27 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:28.768956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a0fe301-06bc-43a7-9314-d01157954e27 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:28.769386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a0fe301-06bc-43a7-9314-d01157954e27 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:28.831903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4a0fe301-06bc-43a7-9314-d01157954e27 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:28.839245 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4a0fe301-06bc-43a7-9314-d01157954e27 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083448 Jun 02 16:21:28.839794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 650/1281] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:28 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:29.856438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-89562c7e-3886-4888-b2d4-66aa07557b73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:29.857084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-89562c7e-3886-4888-b2d4-66aa07557b73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:29.863743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-89562c7e-3886-4888-b2d4-66aa07557b73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:29.864192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-89562c7e-3886-4888-b2d4-66aa07557b73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:29.864961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-89562c7e-3886-4888-b2d4-66aa07557b73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:29.865392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-89562c7e-3886-4888-b2d4-66aa07557b73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:30.000303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-89562c7e-3886-4888-b2d4-66aa07557b73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:30.007852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-89562c7e-3886-4888-b2d4-66aa07557b73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.155347 Jun 02 16:21:30.008425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 632/1282] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:29 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:31.025898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-31babd8d-15bf-4bb0-94bf-95088b40f066 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:31.026641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-31babd8d-15bf-4bb0-94bf-95088b40f066 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:31.033376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31babd8d-15bf-4bb0-94bf-95088b40f066 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:31.033833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31babd8d-15bf-4bb0-94bf-95088b40f066 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:31.034700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31babd8d-15bf-4bb0-94bf-95088b40f066 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:31.035198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31babd8d-15bf-4bb0-94bf-95088b40f066 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:31.151485 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-31babd8d-15bf-4bb0-94bf-95088b40f066 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:31.159155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-31babd8d-15bf-4bb0-94bf-95088b40f066 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.137183 Jun 02 16:21:31.159723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 651/1283] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:31 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:32.176164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1a05d8c9-944a-4633-a364-0192bb1bbbf7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:32.176808 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1a05d8c9-944a-4633-a364-0192bb1bbbf7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:32.183357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1a05d8c9-944a-4633-a364-0192bb1bbbf7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:32.183806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1a05d8c9-944a-4633-a364-0192bb1bbbf7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:32.184566 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1a05d8c9-944a-4633-a364-0192bb1bbbf7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:32.185006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1a05d8c9-944a-4633-a364-0192bb1bbbf7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:32.417700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1a05d8c9-944a-4633-a364-0192bb1bbbf7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:32.426203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1a05d8c9-944a-4633-a364-0192bb1bbbf7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.253293 Jun 02 16:21:32.431318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 633/1284] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:32 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:33.441889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e572b62b-ffe2-4640-b549-ae2b3ac1a299 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:33.442479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e572b62b-ffe2-4640-b549-ae2b3ac1a299 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:33.448877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e572b62b-ffe2-4640-b549-ae2b3ac1a299 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:33.449327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e572b62b-ffe2-4640-b549-ae2b3ac1a299 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:33.450099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e572b62b-ffe2-4640-b549-ae2b3ac1a299 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:33.450543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e572b62b-ffe2-4640-b549-ae2b3ac1a299 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:33.511396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e572b62b-ffe2-4640-b549-ae2b3ac1a299 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:33.519510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e572b62b-ffe2-4640-b549-ae2b3ac1a299 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081530 Jun 02 16:21:33.520083 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 652/1285] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:33 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:34.536854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-41ddcdff-ea02-4085-9ebc-d0d117a05766 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:34.537465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-41ddcdff-ea02-4085-9ebc-d0d117a05766 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:34.543999 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ddcdff-ea02-4085-9ebc-d0d117a05766 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:34.544491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ddcdff-ea02-4085-9ebc-d0d117a05766 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:34.545260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ddcdff-ea02-4085-9ebc-d0d117a05766 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:34.545758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ddcdff-ea02-4085-9ebc-d0d117a05766 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:34.605532 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-41ddcdff-ea02-4085-9ebc-d0d117a05766 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:34.613560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-41ddcdff-ea02-4085-9ebc-d0d117a05766 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081048 Jun 02 16:21:34.614137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 634/1286] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:34 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:35.630915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5cd490fd-4f51-4dc0-b060-dabec32c1687 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:35.631442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5cd490fd-4f51-4dc0-b060-dabec32c1687 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:35.637924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cd490fd-4f51-4dc0-b060-dabec32c1687 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:35.638401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cd490fd-4f51-4dc0-b060-dabec32c1687 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:35.639152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cd490fd-4f51-4dc0-b060-dabec32c1687 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:35.640243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cd490fd-4f51-4dc0-b060-dabec32c1687 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:35.704017 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5cd490fd-4f51-4dc0-b060-dabec32c1687 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:35.711642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5cd490fd-4f51-4dc0-b060-dabec32c1687 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084688 Jun 02 16:21:35.712200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 653/1287] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:35 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:36.729938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-eda42cae-6f49-4ed5-a379-6b9fe22e3b00 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:36.730529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-eda42cae-6f49-4ed5-a379-6b9fe22e3b00 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:36.737681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eda42cae-6f49-4ed5-a379-6b9fe22e3b00 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:36.738163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eda42cae-6f49-4ed5-a379-6b9fe22e3b00 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:36.738927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eda42cae-6f49-4ed5-a379-6b9fe22e3b00 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:36.739365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eda42cae-6f49-4ed5-a379-6b9fe22e3b00 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:36.798997 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eda42cae-6f49-4ed5-a379-6b9fe22e3b00 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:36.806403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-eda42cae-6f49-4ed5-a379-6b9fe22e3b00 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080300 Jun 02 16:21:36.806958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 635/1288] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:36 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:37.823433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-15b399d2-4f02-4a22-8cb5-63ec36d021e3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:37.823978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-15b399d2-4f02-4a22-8cb5-63ec36d021e3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:37.831208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15b399d2-4f02-4a22-8cb5-63ec36d021e3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:37.831657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15b399d2-4f02-4a22-8cb5-63ec36d021e3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:37.832405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15b399d2-4f02-4a22-8cb5-63ec36d021e3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:37.832834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15b399d2-4f02-4a22-8cb5-63ec36d021e3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:37.893988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-15b399d2-4f02-4a22-8cb5-63ec36d021e3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:37.901353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-15b399d2-4f02-4a22-8cb5-63ec36d021e3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081896 Jun 02 16:21:37.901918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 654/1289] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:37 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:38.918400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-329b0b21-3aae-4cdd-afed-8c696dabaea9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:38.918940 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-329b0b21-3aae-4cdd-afed-8c696dabaea9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:38.925732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-329b0b21-3aae-4cdd-afed-8c696dabaea9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:38.926220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-329b0b21-3aae-4cdd-afed-8c696dabaea9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:38.926985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-329b0b21-3aae-4cdd-afed-8c696dabaea9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:38.927423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-329b0b21-3aae-4cdd-afed-8c696dabaea9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:38.988241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-329b0b21-3aae-4cdd-afed-8c696dabaea9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:38.995583 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-329b0b21-3aae-4cdd-afed-8c696dabaea9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081167 Jun 02 16:21:38.996137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 636/1290] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:38 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:40.012978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fe477340-c391-4f7b-9e85-e9f2f9d35c3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:40.013593 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fe477340-c391-4f7b-9e85-e9f2f9d35c3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:40.020784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe477340-c391-4f7b-9e85-e9f2f9d35c3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:40.021243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe477340-c391-4f7b-9e85-e9f2f9d35c3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:40.022008 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe477340-c391-4f7b-9e85-e9f2f9d35c3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:40.022476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe477340-c391-4f7b-9e85-e9f2f9d35c3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:40.084042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fe477340-c391-4f7b-9e85-e9f2f9d35c3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:40.091527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fe477340-c391-4f7b-9e85-e9f2f9d35c3d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082508 Jun 02 16:21:40.092089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 655/1291] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:40 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:41.112612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-be9380aa-7eb8-4f47-b8e1-7e70fd138a81 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:41.113222 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-be9380aa-7eb8-4f47-b8e1-7e70fd138a81 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:41.119921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be9380aa-7eb8-4f47-b8e1-7e70fd138a81 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:41.120360 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be9380aa-7eb8-4f47-b8e1-7e70fd138a81 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:41.121146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be9380aa-7eb8-4f47-b8e1-7e70fd138a81 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:41.121588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be9380aa-7eb8-4f47-b8e1-7e70fd138a81 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:41.189902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-be9380aa-7eb8-4f47-b8e1-7e70fd138a81 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:41.197477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-be9380aa-7eb8-4f47-b8e1-7e70fd138a81 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.092751 Jun 02 16:21:41.198047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 637/1292] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:41 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:42.213621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bfbc111c-3ec7-4dad-9fdd-1b7b2823b162 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:42.214265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bfbc111c-3ec7-4dad-9fdd-1b7b2823b162 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:42.221746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bfbc111c-3ec7-4dad-9fdd-1b7b2823b162 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:42.222223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bfbc111c-3ec7-4dad-9fdd-1b7b2823b162 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:42.222985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bfbc111c-3ec7-4dad-9fdd-1b7b2823b162 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:42.223424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bfbc111c-3ec7-4dad-9fdd-1b7b2823b162 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:42.284634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bfbc111c-3ec7-4dad-9fdd-1b7b2823b162 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:42.292127 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bfbc111c-3ec7-4dad-9fdd-1b7b2823b162 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082378 Jun 02 16:21:42.292686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 656/1293] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:42 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:43.308869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-261d4140-3731-42dd-8397-a0ac5e287ab9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:43.309396 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-261d4140-3731-42dd-8397-a0ac5e287ab9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:43.316633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-261d4140-3731-42dd-8397-a0ac5e287ab9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:43.317086 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-261d4140-3731-42dd-8397-a0ac5e287ab9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:43.317855 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-261d4140-3731-42dd-8397-a0ac5e287ab9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:43.318333 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-261d4140-3731-42dd-8397-a0ac5e287ab9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:43.380973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-261d4140-3731-42dd-8397-a0ac5e287ab9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:43.388379 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-261d4140-3731-42dd-8397-a0ac5e287ab9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083512 Jun 02 16:21:43.388956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 638/1294] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:43 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:44.405842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e45843db-086c-4e14-84ab-c561dae66974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:44.406486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e45843db-086c-4e14-84ab-c561dae66974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:44.413035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e45843db-086c-4e14-84ab-c561dae66974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:44.413487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e45843db-086c-4e14-84ab-c561dae66974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:44.414316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e45843db-086c-4e14-84ab-c561dae66974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:44.414759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e45843db-086c-4e14-84ab-c561dae66974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:44.480723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e45843db-086c-4e14-84ab-c561dae66974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:44.488370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e45843db-086c-4e14-84ab-c561dae66974 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086700 Jun 02 16:21:44.488936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 657/1295] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:44 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:45.504798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b62f7671-e533-46da-a4f5-d4e493b495ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:45.505339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b62f7671-e533-46da-a4f5-d4e493b495ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:45.511811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b62f7671-e533-46da-a4f5-d4e493b495ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:45.512297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b62f7671-e533-46da-a4f5-d4e493b495ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:45.513075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b62f7671-e533-46da-a4f5-d4e493b495ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:45.513516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b62f7671-e533-46da-a4f5-d4e493b495ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:45.574452 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b62f7671-e533-46da-a4f5-d4e493b495ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:45.582709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b62f7671-e533-46da-a4f5-d4e493b495ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082032 Jun 02 16:21:45.583269 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 639/1296] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:45 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:46.145648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:21:46.145882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:21:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:21:46.599918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-560b5a7b-2e31-425d-b27d-f0b80ab78e78 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:46.600534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-560b5a7b-2e31-425d-b27d-f0b80ab78e78 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:46.607011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-560b5a7b-2e31-425d-b27d-f0b80ab78e78 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:46.607461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-560b5a7b-2e31-425d-b27d-f0b80ab78e78 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:46.608337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-560b5a7b-2e31-425d-b27d-f0b80ab78e78 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:46.608776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-560b5a7b-2e31-425d-b27d-f0b80ab78e78 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:46.671129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-560b5a7b-2e31-425d-b27d-f0b80ab78e78 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:46.678651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-560b5a7b-2e31-425d-b27d-f0b80ab78e78 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082928 Jun 02 16:21:46.679210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 658/1297] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:46 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:47.696248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-58d5a901-7b19-4a44-ad75-bf2e715c49b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:47.696861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-58d5a901-7b19-4a44-ad75-bf2e715c49b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:47.703544 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58d5a901-7b19-4a44-ad75-bf2e715c49b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:47.703983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58d5a901-7b19-4a44-ad75-bf2e715c49b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:47.704738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58d5a901-7b19-4a44-ad75-bf2e715c49b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:47.705173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58d5a901-7b19-4a44-ad75-bf2e715c49b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:47.765578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-58d5a901-7b19-4a44-ad75-bf2e715c49b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:47.772891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-58d5a901-7b19-4a44-ad75-bf2e715c49b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080649 Jun 02 16:21:47.773479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 640/1298] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:47 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:48.790589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ecbbc8a9-32af-4c99-9deb-d9c52fd8066c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:48.791113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ecbbc8a9-32af-4c99-9deb-d9c52fd8066c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:48.798218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ecbbc8a9-32af-4c99-9deb-d9c52fd8066c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:48.798669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ecbbc8a9-32af-4c99-9deb-d9c52fd8066c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:48.799428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ecbbc8a9-32af-4c99-9deb-d9c52fd8066c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:48.799862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ecbbc8a9-32af-4c99-9deb-d9c52fd8066c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:48.860430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ecbbc8a9-32af-4c99-9deb-d9c52fd8066c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:48.867839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ecbbc8a9-32af-4c99-9deb-d9c52fd8066c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081216 Jun 02 16:21:48.868399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 659/1299] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:48 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:49.885650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a99ab3af-590e-4033-a560-d4e781accd8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:49.886297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a99ab3af-590e-4033-a560-d4e781accd8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:49.893263 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a99ab3af-590e-4033-a560-d4e781accd8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:49.893712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a99ab3af-590e-4033-a560-d4e781accd8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:49.894507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a99ab3af-590e-4033-a560-d4e781accd8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:49.894944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a99ab3af-590e-4033-a560-d4e781accd8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:49.957426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a99ab3af-590e-4033-a560-d4e781accd8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:49.965084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a99ab3af-590e-4033-a560-d4e781accd8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083397 Jun 02 16:21:49.965640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 641/1300] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:49 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:50.983624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c8d1fee4-e24b-4e30-9db6-1ef4a48bb613 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:50.984235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c8d1fee4-e24b-4e30-9db6-1ef4a48bb613 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:50.990706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8d1fee4-e24b-4e30-9db6-1ef4a48bb613 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:50.991148 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8d1fee4-e24b-4e30-9db6-1ef4a48bb613 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:50.991901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8d1fee4-e24b-4e30-9db6-1ef4a48bb613 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:50.992331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c8d1fee4-e24b-4e30-9db6-1ef4a48bb613 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:50.996134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:51.053369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c8d1fee4-e24b-4e30-9db6-1ef4a48bb613 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:51.060949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c8d1fee4-e24b-4e30-9db6-1ef4a48bb613 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081684 Jun 02 16:21:51.061619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 660/1301] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:50 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:52.078266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0dbf573c-356c-40c9-be64-103e4260aeaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:52.078871 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0dbf573c-356c-40c9-be64-103e4260aeaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:52.085267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0dbf573c-356c-40c9-be64-103e4260aeaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:52.085714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0dbf573c-356c-40c9-be64-103e4260aeaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:52.086506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0dbf573c-356c-40c9-be64-103e4260aeaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:52.086938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0dbf573c-356c-40c9-be64-103e4260aeaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:52.149283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0dbf573c-356c-40c9-be64-103e4260aeaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:52.157575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0dbf573c-356c-40c9-be64-103e4260aeaf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083781 Jun 02 16:21:52.158293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 642/1302] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:52 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:53.174449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0f795444-bbfb-420a-961b-b3153e7bc567 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:53.175059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0f795444-bbfb-420a-961b-b3153e7bc567 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:53.177375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=28 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:53.182133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f795444-bbfb-420a-961b-b3153e7bc567 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:53.182577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f795444-bbfb-420a-961b-b3153e7bc567 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:53.183330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f795444-bbfb-420a-961b-b3153e7bc567 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:53.183809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f795444-bbfb-420a-961b-b3153e7bc567 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:53.248920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0f795444-bbfb-420a-961b-b3153e7bc567 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:53.256482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0f795444-bbfb-420a-961b-b3153e7bc567 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085829 Jun 02 16:21:53.257046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 661/1303] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:53 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:54.274105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1eb20a7d-d104-4973-83dc-bb446f9c74f4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:54.274721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1eb20a7d-d104-4973-83dc-bb446f9c74f4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:54.277197 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:54.282963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1eb20a7d-d104-4973-83dc-bb446f9c74f4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:54.283408 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1eb20a7d-d104-4973-83dc-bb446f9c74f4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:54.284164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1eb20a7d-d104-4973-83dc-bb446f9c74f4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:54.284597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1eb20a7d-d104-4973-83dc-bb446f9c74f4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:54.344951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1eb20a7d-d104-4973-83dc-bb446f9c74f4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:54.353133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1eb20a7d-d104-4973-83dc-bb446f9c74f4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082947 Jun 02 16:21:54.353676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 643/1304] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:54 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:55.370364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7163e206-7e75-45e0-9427-f284989f5ed2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:55.371011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7163e206-7e75-45e0-9427-f284989f5ed2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:55.378438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7163e206-7e75-45e0-9427-f284989f5ed2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:55.378896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7163e206-7e75-45e0-9427-f284989f5ed2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:55.379665 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7163e206-7e75-45e0-9427-f284989f5ed2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:55.380104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7163e206-7e75-45e0-9427-f284989f5ed2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:55.441552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7163e206-7e75-45e0-9427-f284989f5ed2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:55.449003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7163e206-7e75-45e0-9427-f284989f5ed2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082520 Jun 02 16:21:55.449553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 662/1305] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:55 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:56.465818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f4729741-0992-412e-85d2-d9dc080f6db0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:56.466475 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f4729741-0992-412e-85d2-d9dc080f6db0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:56.473454 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f4729741-0992-412e-85d2-d9dc080f6db0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:56.473933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f4729741-0992-412e-85d2-d9dc080f6db0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:56.474716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f4729741-0992-412e-85d2-d9dc080f6db0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:56.475149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f4729741-0992-412e-85d2-d9dc080f6db0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:56.479059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=90 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:21:56.538058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f4729741-0992-412e-85d2-d9dc080f6db0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:56.545437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f4729741-0992-412e-85d2-d9dc080f6db0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083534 Jun 02 16:21:56.546026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 644/1306] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:56 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:57.562371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f64326ee-8c99-43ad-b447-dc9a5bda4505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:57.562917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f64326ee-8c99-43ad-b447-dc9a5bda4505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:57.569505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f64326ee-8c99-43ad-b447-dc9a5bda4505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:57.569951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f64326ee-8c99-43ad-b447-dc9a5bda4505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:57.570845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f64326ee-8c99-43ad-b447-dc9a5bda4505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:57.571274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f64326ee-8c99-43ad-b447-dc9a5bda4505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:57.634214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f64326ee-8c99-43ad-b447-dc9a5bda4505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:57.642209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f64326ee-8c99-43ad-b447-dc9a5bda4505 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083795 Jun 02 16:21:57.642786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 663/1307] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:57 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:58.659722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4c042ef3-2cca-4d30-b554-c2bff0a32a9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:58.660331 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4c042ef3-2cca-4d30-b554-c2bff0a32a9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:58.666799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c042ef3-2cca-4d30-b554-c2bff0a32a9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:58.667248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c042ef3-2cca-4d30-b554-c2bff0a32a9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:58.668007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c042ef3-2cca-4d30-b554-c2bff0a32a9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:58.668441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4c042ef3-2cca-4d30-b554-c2bff0a32a9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:58.732828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4c042ef3-2cca-4d30-b554-c2bff0a32a9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:58.741048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4c042ef3-2cca-4d30-b554-c2bff0a32a9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085903 Jun 02 16:21:58.741603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 645/1308] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:58 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:21:59.564410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:21:59.564410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:21:59.757906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-245f80a7-93c7-44fa-a006-b77a732879e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:21:59.758541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-245f80a7-93c7-44fa-a006-b77a732879e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:21:59.765021 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-245f80a7-93c7-44fa-a006-b77a732879e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:59.765498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-245f80a7-93c7-44fa-a006-b77a732879e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:59.766292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-245f80a7-93c7-44fa-a006-b77a732879e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:21:59.766729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-245f80a7-93c7-44fa-a006-b77a732879e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:21:59.829081 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-245f80a7-93c7-44fa-a006-b77a732879e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:21:59.836469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-245f80a7-93c7-44fa-a006-b77a732879e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082413 Jun 02 16:21:59.837035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 664/1309] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:21:59 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:00.852776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-680222fe-647b-4665-9cf3-effb19d68d4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:00.853419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-680222fe-647b-4665-9cf3-effb19d68d4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:00.860097 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-680222fe-647b-4665-9cf3-effb19d68d4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:00.860551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-680222fe-647b-4665-9cf3-effb19d68d4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:00.861322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-680222fe-647b-4665-9cf3-effb19d68d4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:00.861764 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-680222fe-647b-4665-9cf3-effb19d68d4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:00.923245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-680222fe-647b-4665-9cf3-effb19d68d4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:00.930821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-680222fe-647b-4665-9cf3-effb19d68d4b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081970 Jun 02 16:22:00.931384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 646/1310] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:00 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:01.948329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-32dcd878-252c-46f2-84d1-2ed059b35849 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:01.948955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-32dcd878-252c-46f2-84d1-2ed059b35849 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:01.956971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32dcd878-252c-46f2-84d1-2ed059b35849 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:01.957421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32dcd878-252c-46f2-84d1-2ed059b35849 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:01.958226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32dcd878-252c-46f2-84d1-2ed059b35849 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:01.958665 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32dcd878-252c-46f2-84d1-2ed059b35849 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:02.023513 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-32dcd878-252c-46f2-84d1-2ed059b35849 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:02.032101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-32dcd878-252c-46f2-84d1-2ed059b35849 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087705 Jun 02 16:22:02.032664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 665/1311] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:01 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:03.048782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d15fba38-80ff-4a06-a7f5-7b3d62d4b715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:03.049388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d15fba38-80ff-4a06-a7f5-7b3d62d4b715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:03.055945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d15fba38-80ff-4a06-a7f5-7b3d62d4b715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:03.056385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d15fba38-80ff-4a06-a7f5-7b3d62d4b715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:03.057135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d15fba38-80ff-4a06-a7f5-7b3d62d4b715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:03.057566 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d15fba38-80ff-4a06-a7f5-7b3d62d4b715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:03.118599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d15fba38-80ff-4a06-a7f5-7b3d62d4b715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:03.126303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d15fba38-80ff-4a06-a7f5-7b3d62d4b715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081871 Jun 02 16:22:03.126857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 647/1312] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:03 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:04.143257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-58271526-0c88-4683-9eab-3acc888eadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:04.143867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-58271526-0c88-4683-9eab-3acc888eadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:04.150389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-58271526-0c88-4683-9eab-3acc888eadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:04.150840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-58271526-0c88-4683-9eab-3acc888eadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:04.151602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-58271526-0c88-4683-9eab-3acc888eadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:04.152064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-58271526-0c88-4683-9eab-3acc888eadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:04.212755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-58271526-0c88-4683-9eab-3acc888eadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:04.220392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-58271526-0c88-4683-9eab-3acc888eadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081085 Jun 02 16:22:04.221210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 666/1313] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:04 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:05.237349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4fa49712-d713-48d6-8093-d1f11cbb0f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:05.237969 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4fa49712-d713-48d6-8093-d1f11cbb0f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:05.244664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4fa49712-d713-48d6-8093-d1f11cbb0f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:05.245117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4fa49712-d713-48d6-8093-d1f11cbb0f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:05.245885 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4fa49712-d713-48d6-8093-d1f11cbb0f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:05.246364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4fa49712-d713-48d6-8093-d1f11cbb0f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:05.308665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4fa49712-d713-48d6-8093-d1f11cbb0f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:05.317189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4fa49712-d713-48d6-8093-d1f11cbb0f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084378 Jun 02 16:22:05.317760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 648/1314] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:06.334023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7310574d-e6b9-423d-9599-a004a5cdd78a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:06.334685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7310574d-e6b9-423d-9599-a004a5cdd78a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:06.341110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7310574d-e6b9-423d-9599-a004a5cdd78a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:06.341561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7310574d-e6b9-423d-9599-a004a5cdd78a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:06.342349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7310574d-e6b9-423d-9599-a004a5cdd78a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:06.343517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7310574d-e6b9-423d-9599-a004a5cdd78a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:06.404654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7310574d-e6b9-423d-9599-a004a5cdd78a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:06.413106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7310574d-e6b9-423d-9599-a004a5cdd78a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083006 Jun 02 16:22:06.413668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 667/1315] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:06 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:07.430359 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ee5ee6e4-5a93-4484-9ff5-e4b1f8282c6b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:07.430902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ee5ee6e4-5a93-4484-9ff5-e4b1f8282c6b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:07.437908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee5ee6e4-5a93-4484-9ff5-e4b1f8282c6b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:07.438378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee5ee6e4-5a93-4484-9ff5-e4b1f8282c6b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:07.439133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee5ee6e4-5a93-4484-9ff5-e4b1f8282c6b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:07.439566 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee5ee6e4-5a93-4484-9ff5-e4b1f8282c6b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:07.503347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ee5ee6e4-5a93-4484-9ff5-e4b1f8282c6b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:07.510911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ee5ee6e4-5a93-4484-9ff5-e4b1f8282c6b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084664 Jun 02 16:22:07.511468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 649/1316] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:07 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:22:08.528908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3d216608-2f67-4e33-abe0-15c6245321e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:08.529525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3d216608-2f67-4e33-abe0-15c6245321e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:08.536726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d216608-2f67-4e33-abe0-15c6245321e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:08.537177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d216608-2f67-4e33-abe0-15c6245321e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:08.537936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d216608-2f67-4e33-abe0-15c6245321e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:08.538399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d216608-2f67-4e33-abe0-15c6245321e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:08.599773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3d216608-2f67-4e33-abe0-15c6245321e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:08.607286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3d216608-2f67-4e33-abe0-15c6245321e8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082567 Jun 02 16:22:08.607845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 668/1317] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:08 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:22:09.624735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b3ce06c5-293b-4cb3-8091-311d9ba224ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:09.625280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b3ce06c5-293b-4cb3-8091-311d9ba224ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:09.631747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3ce06c5-293b-4cb3-8091-311d9ba224ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:09.632195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3ce06c5-293b-4cb3-8091-311d9ba224ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:09.632953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3ce06c5-293b-4cb3-8091-311d9ba224ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:09.633384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3ce06c5-293b-4cb3-8091-311d9ba224ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:09.694627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b3ce06c5-293b-4cb3-8091-311d9ba224ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:09.703179 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b3ce06c5-293b-4cb3-8091-311d9ba224ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081452 Jun 02 16:22:09.703750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 650/1318] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:09 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:10.721048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-22fed8d3-8ffe-44ce-80d8-80557c301893 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:10.721586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-22fed8d3-8ffe-44ce-80d8-80557c301893 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:10.728531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22fed8d3-8ffe-44ce-80d8-80557c301893 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:10.728968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22fed8d3-8ffe-44ce-80d8-80557c301893 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:10.729733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22fed8d3-8ffe-44ce-80d8-80557c301893 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:10.730238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22fed8d3-8ffe-44ce-80d8-80557c301893 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:10.794007 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-22fed8d3-8ffe-44ce-80d8-80557c301893 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:10.802182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-22fed8d3-8ffe-44ce-80d8-80557c301893 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086128 Jun 02 16:22:10.802743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 669/1319] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:11.818772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e04ff747-8efd-40d2-be78-b60e39180f59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:11.819380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e04ff747-8efd-40d2-be78-b60e39180f59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:11.829474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e04ff747-8efd-40d2-be78-b60e39180f59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:11.829474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e04ff747-8efd-40d2-be78-b60e39180f59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:11.829474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e04ff747-8efd-40d2-be78-b60e39180f59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:11.829474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e04ff747-8efd-40d2-be78-b60e39180f59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:11.889967 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e04ff747-8efd-40d2-be78-b60e39180f59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:11.897366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e04ff747-8efd-40d2-be78-b60e39180f59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082551 Jun 02 16:22:11.897926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 651/1320] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:12.914451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-77287960-c1be-4fea-b0f0-e6314f38572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:12.915020 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-77287960-c1be-4fea-b0f0-e6314f38572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:12.921507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77287960-c1be-4fea-b0f0-e6314f38572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:12.921948 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77287960-c1be-4fea-b0f0-e6314f38572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:12.922735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77287960-c1be-4fea-b0f0-e6314f38572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:12.923165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77287960-c1be-4fea-b0f0-e6314f38572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:12.985027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-77287960-c1be-4fea-b0f0-e6314f38572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:12.992349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-77287960-c1be-4fea-b0f0-e6314f38572a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081872 Jun 02 16:22:12.992901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 670/1321] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:14.008790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ea0335be-406e-4dcc-aec1-4c6469678b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:14.009408 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ea0335be-406e-4dcc-aec1-4c6469678b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:14.016606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea0335be-406e-4dcc-aec1-4c6469678b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:14.017057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea0335be-406e-4dcc-aec1-4c6469678b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:14.017825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea0335be-406e-4dcc-aec1-4c6469678b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:14.018307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea0335be-406e-4dcc-aec1-4c6469678b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:14.080337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ea0335be-406e-4dcc-aec1-4c6469678b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:14.087778 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ea0335be-406e-4dcc-aec1-4c6469678b09 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082992 Jun 02 16:22:14.088347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 652/1322] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:15.104649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6ba4abf8-d2db-46f2-9a21-4c844b02e6bf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:15.105263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6ba4abf8-d2db-46f2-9a21-4c844b02e6bf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:15.111930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ba4abf8-d2db-46f2-9a21-4c844b02e6bf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:15.112378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ba4abf8-d2db-46f2-9a21-4c844b02e6bf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:15.113139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ba4abf8-d2db-46f2-9a21-4c844b02e6bf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:15.113574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ba4abf8-d2db-46f2-9a21-4c844b02e6bf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:15.174458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6ba4abf8-d2db-46f2-9a21-4c844b02e6bf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:15.181794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6ba4abf8-d2db-46f2-9a21-4c844b02e6bf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080993 Jun 02 16:22:15.182386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 671/1323] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:16.199041 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-861db9a3-70c5-433d-8c6a-8355cb84cae5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:16.199658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-861db9a3-70c5-433d-8c6a-8355cb84cae5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:16.206798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-861db9a3-70c5-433d-8c6a-8355cb84cae5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:16.207249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-861db9a3-70c5-433d-8c6a-8355cb84cae5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:16.208011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-861db9a3-70c5-433d-8c6a-8355cb84cae5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:16.208488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-861db9a3-70c5-433d-8c6a-8355cb84cae5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:16.275380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-861db9a3-70c5-433d-8c6a-8355cb84cae5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:16.283744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-861db9a3-70c5-433d-8c6a-8355cb84cae5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.088500 Jun 02 16:22:16.284322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 653/1324] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:16 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:17.301376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-031c0d05-4bc2-45d4-ba5d-ca2ccd96372e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:17.301991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-031c0d05-4bc2-45d4-ba5d-ca2ccd96372e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:17.308425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-031c0d05-4bc2-45d4-ba5d-ca2ccd96372e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:17.308864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-031c0d05-4bc2-45d4-ba5d-ca2ccd96372e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:17.309615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-031c0d05-4bc2-45d4-ba5d-ca2ccd96372e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:17.310042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-031c0d05-4bc2-45d4-ba5d-ca2ccd96372e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:17.371314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-031c0d05-4bc2-45d4-ba5d-ca2ccd96372e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:17.378825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-031c0d05-4bc2-45d4-ba5d-ca2ccd96372e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082023 Jun 02 16:22:17.379379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 672/1325] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:17 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:22:18.395123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5dbe4bb4-908e-4ab5-b833-964c9c6ce5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:18.395651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5dbe4bb4-908e-4ab5-b833-964c9c6ce5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:18.402251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5dbe4bb4-908e-4ab5-b833-964c9c6ce5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:18.402704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5dbe4bb4-908e-4ab5-b833-964c9c6ce5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:18.403472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5dbe4bb4-908e-4ab5-b833-964c9c6ce5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:18.403912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5dbe4bb4-908e-4ab5-b833-964c9c6ce5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:18.464569 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5dbe4bb4-908e-4ab5-b833-964c9c6ce5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:18.472930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5dbe4bb4-908e-4ab5-b833-964c9c6ce5e7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081638 Jun 02 16:22:18.473507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 654/1326] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:18 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:19.491132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-33ee1bcd-bafe-438f-84bf-2a83ec29630b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:19.491657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-33ee1bcd-bafe-438f-84bf-2a83ec29630b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:19.498651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33ee1bcd-bafe-438f-84bf-2a83ec29630b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:19.499321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33ee1bcd-bafe-438f-84bf-2a83ec29630b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:19.499845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33ee1bcd-bafe-438f-84bf-2a83ec29630b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:19.500272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33ee1bcd-bafe-438f-84bf-2a83ec29630b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:19.564221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-33ee1bcd-bafe-438f-84bf-2a83ec29630b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:19.571703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-33ee1bcd-bafe-438f-84bf-2a83ec29630b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084542 Jun 02 16:22:19.572263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 673/1327] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:20.588726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-831c9e03-3c2a-4dd7-80c7-25d045ec0dbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:20.589366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-831c9e03-3c2a-4dd7-80c7-25d045ec0dbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:20.596208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-831c9e03-3c2a-4dd7-80c7-25d045ec0dbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:20.596667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-831c9e03-3c2a-4dd7-80c7-25d045ec0dbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:20.597435 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-831c9e03-3c2a-4dd7-80c7-25d045ec0dbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:20.597905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-831c9e03-3c2a-4dd7-80c7-25d045ec0dbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:20.659597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-831c9e03-3c2a-4dd7-80c7-25d045ec0dbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:20.667173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-831c9e03-3c2a-4dd7-80c7-25d045ec0dbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082377 Jun 02 16:22:20.667742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 655/1328] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:20 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:21.684601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-88385697-1901-4c4e-9d71-dd4a4bed2549 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:21.685142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-88385697-1901-4c4e-9d71-dd4a4bed2549 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:21.692088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-88385697-1901-4c4e-9d71-dd4a4bed2549 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:21.692537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-88385697-1901-4c4e-9d71-dd4a4bed2549 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:21.693301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-88385697-1901-4c4e-9d71-dd4a4bed2549 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:21.693735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-88385697-1901-4c4e-9d71-dd4a4bed2549 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:21.696231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:22:21.756508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-88385697-1901-4c4e-9d71-dd4a4bed2549 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:21.764305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-88385697-1901-4c4e-9d71-dd4a4bed2549 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083428 Jun 02 16:22:21.765836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 674/1329] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:22.781723 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f3b04e92-808b-4710-ab8c-d9763c09d522 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:22.782359 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f3b04e92-808b-4710-ab8c-d9763c09d522 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:22.789095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3b04e92-808b-4710-ab8c-d9763c09d522 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:22.789574 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3b04e92-808b-4710-ab8c-d9763c09d522 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:22.790409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3b04e92-808b-4710-ab8c-d9763c09d522 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:22.790854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3b04e92-808b-4710-ab8c-d9763c09d522 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:22.854190 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f3b04e92-808b-4710-ab8c-d9763c09d522 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:22.862355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f3b04e92-808b-4710-ab8c-d9763c09d522 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084462 Jun 02 16:22:22.864352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 656/1330] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:23.880158 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cddecfbe-3a7e-464d-bace-b80b7fe3cd5e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:23.880799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cddecfbe-3a7e-464d-bace-b80b7fe3cd5e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:23.883136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=28 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:22:23.887852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cddecfbe-3a7e-464d-bace-b80b7fe3cd5e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:23.888305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cddecfbe-3a7e-464d-bace-b80b7fe3cd5e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:23.889496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cddecfbe-3a7e-464d-bace-b80b7fe3cd5e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:23.890255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cddecfbe-3a7e-464d-bace-b80b7fe3cd5e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:23.951604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cddecfbe-3a7e-464d-bace-b80b7fe3cd5e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:23.959107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cddecfbe-3a7e-464d-bace-b80b7fe3cd5e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082849 Jun 02 16:22:23.959670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 675/1331] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:23 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:24.976529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-284b40e0-603b-48de-a053-98bee73e89bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:24.977148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-284b40e0-603b-48de-a053-98bee73e89bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:24.984858 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-284b40e0-603b-48de-a053-98bee73e89bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:24.985312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-284b40e0-603b-48de-a053-98bee73e89bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:24.986101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-284b40e0-603b-48de-a053-98bee73e89bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:24.986545 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-284b40e0-603b-48de-a053-98bee73e89bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:25.061052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-284b40e0-603b-48de-a053-98bee73e89bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:25.068581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-284b40e0-603b-48de-a053-98bee73e89bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.095931 Jun 02 16:22:25.070831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 657/1332] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:24 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:26.086522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a3d14548-c580-4dda-b8a1-88befbb889a4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:26.087137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a3d14548-c580-4dda-b8a1-88befbb889a4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:26.093987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a3d14548-c580-4dda-b8a1-88befbb889a4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:26.094471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a3d14548-c580-4dda-b8a1-88befbb889a4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:26.095243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a3d14548-c580-4dda-b8a1-88befbb889a4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:26.095940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a3d14548-c580-4dda-b8a1-88befbb889a4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:26.159144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a3d14548-c580-4dda-b8a1-88befbb889a4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:26.166570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a3d14548-c580-4dda-b8a1-88befbb889a4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083849 Jun 02 16:22:26.167138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 676/1333] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:26 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:27.184275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-50f3246b-f3ca-44ff-966f-0c55d98286a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:27.184896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-50f3246b-f3ca-44ff-966f-0c55d98286a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:27.187963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=30 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:22:27.192787 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50f3246b-f3ca-44ff-966f-0c55d98286a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:27.193242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50f3246b-f3ca-44ff-966f-0c55d98286a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:27.194014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50f3246b-f3ca-44ff-966f-0c55d98286a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:27.194482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50f3246b-f3ca-44ff-966f-0c55d98286a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:27.197043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=84 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:22:27.257679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-50f3246b-f3ca-44ff-966f-0c55d98286a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:27.265469 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-50f3246b-f3ca-44ff-966f-0c55d98286a2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085047 Jun 02 16:22:27.266044 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 658/1334] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:27 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:28.285853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4276249c-ad7e-499c-b67e-b2741c9bc115 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:28.286501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4276249c-ad7e-499c-b67e-b2741c9bc115 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:28.293032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4276249c-ad7e-499c-b67e-b2741c9bc115 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:28.293482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4276249c-ad7e-499c-b67e-b2741c9bc115 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:28.294293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4276249c-ad7e-499c-b67e-b2741c9bc115 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:28.295291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4276249c-ad7e-499c-b67e-b2741c9bc115 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:28.357852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4276249c-ad7e-499c-b67e-b2741c9bc115 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:28.365354 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4276249c-ad7e-499c-b67e-b2741c9bc115 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087141 Jun 02 16:22:28.365916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 677/1335] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:28 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:29.383049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-63395b3e-a089-4004-bc8d-56de4908ce0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:29.383652 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-63395b3e-a089-4004-bc8d-56de4908ce0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:29.390760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63395b3e-a089-4004-bc8d-56de4908ce0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:29.391203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63395b3e-a089-4004-bc8d-56de4908ce0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:29.391956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63395b3e-a089-4004-bc8d-56de4908ce0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:29.392381 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63395b3e-a089-4004-bc8d-56de4908ce0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:29.452448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-63395b3e-a089-4004-bc8d-56de4908ce0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:29.459928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-63395b3e-a089-4004-bc8d-56de4908ce0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080678 Jun 02 16:22:29.460500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 659/1336] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:29 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:22:30.476913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6a3584f9-799b-47c7-a9d3-7628632a3fb9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:30.477535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6a3584f9-799b-47c7-a9d3-7628632a3fb9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:30.484363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a3584f9-799b-47c7-a9d3-7628632a3fb9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:30.484818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a3584f9-799b-47c7-a9d3-7628632a3fb9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:30.485587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a3584f9-799b-47c7-a9d3-7628632a3fb9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:30.486028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a3584f9-799b-47c7-a9d3-7628632a3fb9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:30.546317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6a3584f9-799b-47c7-a9d3-7628632a3fb9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:30.553791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6a3584f9-799b-47c7-a9d3-7628632a3fb9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080844 Jun 02 16:22:30.554392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 678/1337] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:30 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:31.570232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d30c2dc1-19ca-4365-83a5-dd651f5adfe9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:31.570843 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d30c2dc1-19ca-4365-83a5-dd651f5adfe9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:31.577437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d30c2dc1-19ca-4365-83a5-dd651f5adfe9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:31.577882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d30c2dc1-19ca-4365-83a5-dd651f5adfe9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:31.578686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d30c2dc1-19ca-4365-83a5-dd651f5adfe9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:31.579130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d30c2dc1-19ca-4365-83a5-dd651f5adfe9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:31.642372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d30c2dc1-19ca-4365-83a5-dd651f5adfe9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:31.649921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d30c2dc1-19ca-4365-83a5-dd651f5adfe9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083658 Jun 02 16:22:31.650503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 660/1338] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:31 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:32.667640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-16e9be3a-bd6a-4599-a7a9-a90676e6186e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:32.668252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-16e9be3a-bd6a-4599-a7a9-a90676e6186e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:32.675332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16e9be3a-bd6a-4599-a7a9-a90676e6186e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:32.675881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16e9be3a-bd6a-4599-a7a9-a90676e6186e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:32.681058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16e9be3a-bd6a-4599-a7a9-a90676e6186e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:32.683694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16e9be3a-bd6a-4599-a7a9-a90676e6186e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:32.744309 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-16e9be3a-bd6a-4599-a7a9-a90676e6186e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:32.753010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-16e9be3a-bd6a-4599-a7a9-a90676e6186e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.089200 Jun 02 16:22:32.753582 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 679/1339] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:32 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:33.768953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e47ad751-d622-4fcd-b11d-9543f87d78dc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:33.769562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e47ad751-d622-4fcd-b11d-9543f87d78dc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:33.776095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e47ad751-d622-4fcd-b11d-9543f87d78dc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:33.776539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e47ad751-d622-4fcd-b11d-9543f87d78dc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:33.777299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e47ad751-d622-4fcd-b11d-9543f87d78dc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:33.777730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e47ad751-d622-4fcd-b11d-9543f87d78dc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:33.841394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e47ad751-d622-4fcd-b11d-9543f87d78dc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:33.849665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e47ad751-d622-4fcd-b11d-9543f87d78dc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084569 Jun 02 16:22:33.850245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 661/1340] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:33 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:22:34.867075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9683fdba-0d71-4d65-a4ba-2477895be523 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:34.867610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9683fdba-0d71-4d65-a4ba-2477895be523 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:34.874111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9683fdba-0d71-4d65-a4ba-2477895be523 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:34.874560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9683fdba-0d71-4d65-a4ba-2477895be523 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:34.875316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9683fdba-0d71-4d65-a4ba-2477895be523 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:34.875748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9683fdba-0d71-4d65-a4ba-2477895be523 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:34.937110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9683fdba-0d71-4d65-a4ba-2477895be523 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:34.944545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9683fdba-0d71-4d65-a4ba-2477895be523 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081422 Jun 02 16:22:34.945100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 680/1341] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:34 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:35.969312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1e31dded-84ad-42eb-abb5-92ec4cd523db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:35.969854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1e31dded-84ad-42eb-abb5-92ec4cd523db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:35.976582 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e31dded-84ad-42eb-abb5-92ec4cd523db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:35.977031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e31dded-84ad-42eb-abb5-92ec4cd523db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:35.977792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e31dded-84ad-42eb-abb5-92ec4cd523db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:35.978243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e31dded-84ad-42eb-abb5-92ec4cd523db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:36.039485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1e31dded-84ad-42eb-abb5-92ec4cd523db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:36.047538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1e31dded-84ad-42eb-abb5-92ec4cd523db tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082719 Jun 02 16:22:36.048096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 662/1342] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:35 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:37.064518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e065d021-1675-487f-81d5-e43f4aef6321 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:37.065137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e065d021-1675-487f-81d5-e43f4aef6321 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:37.071668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e065d021-1675-487f-81d5-e43f4aef6321 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:37.072123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e065d021-1675-487f-81d5-e43f4aef6321 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:37.072949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e065d021-1675-487f-81d5-e43f4aef6321 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:37.073395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e065d021-1675-487f-81d5-e43f4aef6321 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:37.136883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e065d021-1675-487f-81d5-e43f4aef6321 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:37.145027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e065d021-1675-487f-81d5-e43f4aef6321 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084655 Jun 02 16:22:37.145586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 681/1343] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:37 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:38.162892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-00c875be-d283-4d86-b767-4108e7fd3b58 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:38.163510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-00c875be-d283-4d86-b767-4108e7fd3b58 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:38.170886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-00c875be-d283-4d86-b767-4108e7fd3b58 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:38.171341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-00c875be-d283-4d86-b767-4108e7fd3b58 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:38.172156 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-00c875be-d283-4d86-b767-4108e7fd3b58 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:38.172595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-00c875be-d283-4d86-b767-4108e7fd3b58 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:38.237046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-00c875be-d283-4d86-b767-4108e7fd3b58 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:38.244542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-00c875be-d283-4d86-b767-4108e7fd3b58 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085603 Jun 02 16:22:38.245113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 663/1344] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:38 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:39.261324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f5828c93-2c7b-49e8-b16c-ef687ea6c22f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:39.261935 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f5828c93-2c7b-49e8-b16c-ef687ea6c22f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:39.269339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5828c93-2c7b-49e8-b16c-ef687ea6c22f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:39.269793 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5828c93-2c7b-49e8-b16c-ef687ea6c22f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:39.270597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5828c93-2c7b-49e8-b16c-ef687ea6c22f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:39.271035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5828c93-2c7b-49e8-b16c-ef687ea6c22f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:39.332150 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f5828c93-2c7b-49e8-b16c-ef687ea6c22f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:39.339649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f5828c93-2c7b-49e8-b16c-ef687ea6c22f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082204 Jun 02 16:22:39.340201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 682/1345] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:39 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:40.356561 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3f73d648-801e-4d94-a3f7-d615f36060df tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:40.357602 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3f73d648-801e-4d94-a3f7-d615f36060df tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:40.363958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f73d648-801e-4d94-a3f7-d615f36060df tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:40.364404 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f73d648-801e-4d94-a3f7-d615f36060df tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:40.365166 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f73d648-801e-4d94-a3f7-d615f36060df tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:40.365600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f73d648-801e-4d94-a3f7-d615f36060df tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:40.425837 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3f73d648-801e-4d94-a3f7-d615f36060df tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:40.433544 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3f73d648-801e-4d94-a3f7-d615f36060df tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080779 Jun 02 16:22:40.434124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 664/1346] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:40 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:41.451325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b1cc109d-62f8-4a7a-baff-dcc7386469c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:41.451865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b1cc109d-62f8-4a7a-baff-dcc7386469c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:41.458066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1cc109d-62f8-4a7a-baff-dcc7386469c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:41.458542 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1cc109d-62f8-4a7a-baff-dcc7386469c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:41.459305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1cc109d-62f8-4a7a-baff-dcc7386469c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:41.459741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b1cc109d-62f8-4a7a-baff-dcc7386469c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:41.522362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b1cc109d-62f8-4a7a-baff-dcc7386469c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:41.530338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b1cc109d-62f8-4a7a-baff-dcc7386469c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083011 Jun 02 16:22:41.530911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 683/1347] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:41 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:42.547592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-979b07c5-ed63-4f1d-b200-38c72817f058 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:42.548227 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-979b07c5-ed63-4f1d-b200-38c72817f058 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:42.554671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-979b07c5-ed63-4f1d-b200-38c72817f058 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:42.555117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-979b07c5-ed63-4f1d-b200-38c72817f058 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:42.555863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-979b07c5-ed63-4f1d-b200-38c72817f058 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:42.556293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-979b07c5-ed63-4f1d-b200-38c72817f058 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:42.620315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-979b07c5-ed63-4f1d-b200-38c72817f058 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:42.628340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-979b07c5-ed63-4f1d-b200-38c72817f058 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085166 Jun 02 16:22:42.628901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 665/1348] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:42 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:43.645917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1bedc3c7-be60-43e6-acfe-0f483351212c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:43.646491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1bedc3c7-be60-43e6-acfe-0f483351212c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:43.653163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bedc3c7-be60-43e6-acfe-0f483351212c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:43.653606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bedc3c7-be60-43e6-acfe-0f483351212c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:43.654386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bedc3c7-be60-43e6-acfe-0f483351212c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:43.654845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1bedc3c7-be60-43e6-acfe-0f483351212c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:43.715085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1bedc3c7-be60-43e6-acfe-0f483351212c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:43.722825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1bedc3c7-be60-43e6-acfe-0f483351212c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080848 Jun 02 16:22:43.723392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 684/1349] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:43 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:44.740170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7b8f68fe-a7ab-4f9b-bb52-0427b003e952 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:44.740706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7b8f68fe-a7ab-4f9b-bb52-0427b003e952 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:44.747107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b8f68fe-a7ab-4f9b-bb52-0427b003e952 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:44.747551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b8f68fe-a7ab-4f9b-bb52-0427b003e952 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:44.748300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b8f68fe-a7ab-4f9b-bb52-0427b003e952 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:44.748850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b8f68fe-a7ab-4f9b-bb52-0427b003e952 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:44.809449 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7b8f68fe-a7ab-4f9b-bb52-0427b003e952 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:44.817617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7b8f68fe-a7ab-4f9b-bb52-0427b003e952 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081382 Jun 02 16:22:44.818222 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 666/1350] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:44 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:45.835773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8d53d0ae-3948-4566-a72f-f88e48d64167 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:45.836385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8d53d0ae-3948-4566-a72f-f88e48d64167 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:45.843481 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d53d0ae-3948-4566-a72f-f88e48d64167 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:45.843930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d53d0ae-3948-4566-a72f-f88e48d64167 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:45.844686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d53d0ae-3948-4566-a72f-f88e48d64167 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:45.845119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d53d0ae-3948-4566-a72f-f88e48d64167 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:45.908128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8d53d0ae-3948-4566-a72f-f88e48d64167 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:45.915556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8d53d0ae-3948-4566-a72f-f88e48d64167 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083650 Jun 02 16:22:45.916123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 685/1351] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:45 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:46.933265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f8396011-959d-4a8d-89e4-97f8a47371e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:46.933879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f8396011-959d-4a8d-89e4-97f8a47371e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:46.940677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8396011-959d-4a8d-89e4-97f8a47371e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:46.941130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8396011-959d-4a8d-89e4-97f8a47371e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:46.941885 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8396011-959d-4a8d-89e4-97f8a47371e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:46.942352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8396011-959d-4a8d-89e4-97f8a47371e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:47.003843 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f8396011-959d-4a8d-89e4-97f8a47371e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:47.011232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f8396011-959d-4a8d-89e4-97f8a47371e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082021 Jun 02 16:22:47.011816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 667/1352] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:46 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:48.028634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9a40ea2d-22cd-4a78-8b45-3a08ae5f9a61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:48.029276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9a40ea2d-22cd-4a78-8b45-3a08ae5f9a61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:48.036014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a40ea2d-22cd-4a78-8b45-3a08ae5f9a61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:48.036467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a40ea2d-22cd-4a78-8b45-3a08ae5f9a61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:48.037266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a40ea2d-22cd-4a78-8b45-3a08ae5f9a61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:48.037714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a40ea2d-22cd-4a78-8b45-3a08ae5f9a61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:48.101155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9a40ea2d-22cd-4a78-8b45-3a08ae5f9a61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:48.109328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9a40ea2d-22cd-4a78-8b45-3a08ae5f9a61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083953 Jun 02 16:22:48.109902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 686/1353] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:48 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:49.126953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ccbc256f-8c8a-472a-8a07-d5409f3fed28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:49.127562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ccbc256f-8c8a-472a-8a07-d5409f3fed28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:49.134031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ccbc256f-8c8a-472a-8a07-d5409f3fed28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:49.134499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ccbc256f-8c8a-472a-8a07-d5409f3fed28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:49.135256 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ccbc256f-8c8a-472a-8a07-d5409f3fed28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:49.135690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ccbc256f-8c8a-472a-8a07-d5409f3fed28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:49.197112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ccbc256f-8c8a-472a-8a07-d5409f3fed28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:49.205293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ccbc256f-8c8a-472a-8a07-d5409f3fed28 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083037 Jun 02 16:22:49.205854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 668/1354] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:49 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:50.223774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6f4dc8bc-986f-44a9-a5bb-bb043185a62f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:50.224521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6f4dc8bc-986f-44a9-a5bb-bb043185a62f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:50.231097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f4dc8bc-986f-44a9-a5bb-bb043185a62f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:50.231542 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f4dc8bc-986f-44a9-a5bb-bb043185a62f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:50.232307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f4dc8bc-986f-44a9-a5bb-bb043185a62f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:50.232743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f4dc8bc-986f-44a9-a5bb-bb043185a62f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:50.294285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6f4dc8bc-986f-44a9-a5bb-bb043185a62f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:50.301959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6f4dc8bc-986f-44a9-a5bb-bb043185a62f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082372 Jun 02 16:22:50.302549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 687/1355] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:50 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:51.318815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d4d24db0-3917-4ed8-bb81-3178c36a6772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:51.319432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d4d24db0-3917-4ed8-bb81-3178c36a6772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:51.325966 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d4d24db0-3917-4ed8-bb81-3178c36a6772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:51.326451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d4d24db0-3917-4ed8-bb81-3178c36a6772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:51.327251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d4d24db0-3917-4ed8-bb81-3178c36a6772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:51.327759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d4d24db0-3917-4ed8-bb81-3178c36a6772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:51.392147 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d4d24db0-3917-4ed8-bb81-3178c36a6772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:51.404298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d4d24db0-3917-4ed8-bb81-3178c36a6772 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084691 Jun 02 16:22:51.404298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 669/1356] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:51 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:52.417183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-832ae059-89d7-4ebe-8f75-d3d22e3c392b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:52.417822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-832ae059-89d7-4ebe-8f75-d3d22e3c392b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:52.424931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-832ae059-89d7-4ebe-8f75-d3d22e3c392b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:52.425351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-832ae059-89d7-4ebe-8f75-d3d22e3c392b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:52.426153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-832ae059-89d7-4ebe-8f75-d3d22e3c392b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:52.426600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-832ae059-89d7-4ebe-8f75-d3d22e3c392b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:52.429195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:22:52.488887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-832ae059-89d7-4ebe-8f75-d3d22e3c392b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:52.496323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-832ae059-89d7-4ebe-8f75-d3d22e3c392b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083020 Jun 02 16:22:52.496889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 688/1357] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:52 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:53.513802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a4b2ba0b-7646-4999-b410-5e995e571270 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:53.514402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a4b2ba0b-7646-4999-b410-5e995e571270 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:53.521894 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4b2ba0b-7646-4999-b410-5e995e571270 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:53.522377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4b2ba0b-7646-4999-b410-5e995e571270 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:53.523145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4b2ba0b-7646-4999-b410-5e995e571270 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:53.523586 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4b2ba0b-7646-4999-b410-5e995e571270 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:53.587064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a4b2ba0b-7646-4999-b410-5e995e571270 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:53.595348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a4b2ba0b-7646-4999-b410-5e995e571270 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085474 Jun 02 16:22:53.596299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 670/1358] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:53 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:54.143605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-621ef2b2-bef2-4292-bca9-ae5840248aca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:54.144110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-621ef2b2-bef2-4292-bca9-ae5840248aca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:54.146428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=28 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:22:54.151161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-621ef2b2-bef2-4292-bca9-ae5840248aca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:54.151604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-621ef2b2-bef2-4292-bca9-ae5840248aca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:54.152348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-621ef2b2-bef2-4292-bca9-ae5840248aca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:54.152778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-621ef2b2-bef2-4292-bca9-ae5840248aca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:54.179564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-621ef2b2-bef2-4292-bca9-ae5840248aca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:22:54.289704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.compute.api [None req-621ef2b2-bef2-4292-bca9-ae5840248aca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Instance is already in deleting state, ignoring this request Jun 02 16:22:54.290552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-621ef2b2-bef2-4292-bca9-ae5840248aca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "DELETE /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 204 len: 0 microversion: 2.1 time: 0.151268 Jun 02 16:22:54.291101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 689/1359] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:22:54 2022] DELETE /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:22:54.299763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a6795c16-a901-40cc-adac-8867fd7c0fbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:54.300368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a6795c16-a901-40cc-adac-8867fd7c0fbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:54.306354 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a6795c16-a901-40cc-adac-8867fd7c0fbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:54.306799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a6795c16-a901-40cc-adac-8867fd7c0fbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:54.307549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a6795c16-a901-40cc-adac-8867fd7c0fbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:54.308011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a6795c16-a901-40cc-adac-8867fd7c0fbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:54.368412 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a6795c16-a901-40cc-adac-8867fd7c0fbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:54.376593 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a6795c16-a901-40cc-adac-8867fd7c0fbc tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081273 Jun 02 16:22:54.377247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 671/1360] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:54 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:55.394778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-31154baa-8754-4e72-b84a-00c52599dc92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:55.395336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-31154baa-8754-4e72-b84a-00c52599dc92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:55.401722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31154baa-8754-4e72-b84a-00c52599dc92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:55.402215 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31154baa-8754-4e72-b84a-00c52599dc92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:55.402984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31154baa-8754-4e72-b84a-00c52599dc92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:55.403420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31154baa-8754-4e72-b84a-00c52599dc92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:55.469301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-31154baa-8754-4e72-b84a-00c52599dc92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:55.477060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-31154baa-8754-4e72-b84a-00c52599dc92 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086425 Jun 02 16:22:55.477619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 690/1361] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:55 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:56.493819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2784268a-43fc-4a71-99a0-62e56a9966a1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:56.494455 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2784268a-43fc-4a71-99a0-62e56a9966a1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:56.501071 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2784268a-43fc-4a71-99a0-62e56a9966a1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:56.501508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2784268a-43fc-4a71-99a0-62e56a9966a1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:56.502289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2784268a-43fc-4a71-99a0-62e56a9966a1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:56.502720 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2784268a-43fc-4a71-99a0-62e56a9966a1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:56.562821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2784268a-43fc-4a71-99a0-62e56a9966a1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:56.570311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2784268a-43fc-4a71-99a0-62e56a9966a1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080291 Jun 02 16:22:56.570909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 672/1362] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:56 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:57.587872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-54c91b52-875c-41a5-a182-bfdb86e7a7b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:57.588439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-54c91b52-875c-41a5-a182-bfdb86e7a7b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:57.595357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54c91b52-875c-41a5-a182-bfdb86e7a7b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:57.596170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54c91b52-875c-41a5-a182-bfdb86e7a7b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:57.596977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54c91b52-875c-41a5-a182-bfdb86e7a7b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:57.597405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54c91b52-875c-41a5-a182-bfdb86e7a7b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:57.658173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-54c91b52-875c-41a5-a182-bfdb86e7a7b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:57.665585 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-54c91b52-875c-41a5-a182-bfdb86e7a7b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081690 Jun 02 16:22:57.666162 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 691/1363] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:57 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:58.682641 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d071566c-91fc-460c-bd2b-b4a422520afe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:58.683260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d071566c-91fc-460c-bd2b-b4a422520afe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:58.685563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=30 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:22:58.691433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d071566c-91fc-460c-bd2b-b4a422520afe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:58.691880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d071566c-91fc-460c-bd2b-b4a422520afe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:58.692648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d071566c-91fc-460c-bd2b-b4a422520afe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:58.693088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d071566c-91fc-460c-bd2b-b4a422520afe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:58.696996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=90 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:22:58.758100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d071566c-91fc-460c-bd2b-b4a422520afe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:58.765955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d071566c-91fc-460c-bd2b-b4a422520afe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086879 Jun 02 16:22:58.766720 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 673/1364] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:58 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:22:59.782883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0b68920d-1d2a-4eda-9d8c-3184d6407777 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:22:59.783486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0b68920d-1d2a-4eda-9d8c-3184d6407777 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:22:59.790705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b68920d-1d2a-4eda-9d8c-3184d6407777 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:59.791161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b68920d-1d2a-4eda-9d8c-3184d6407777 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:59.791930 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b68920d-1d2a-4eda-9d8c-3184d6407777 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:22:59.792369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b68920d-1d2a-4eda-9d8c-3184d6407777 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:22:59.852651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0b68920d-1d2a-4eda-9d8c-3184d6407777 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:22:59.860058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0b68920d-1d2a-4eda-9d8c-3184d6407777 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080978 Jun 02 16:22:59.860616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 692/1365] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:22:59 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:00.877752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b8ed68b4-11fe-4291-bbe5-e4484ca859f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:00.878327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b8ed68b4-11fe-4291-bbe5-e4484ca859f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:00.885330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b8ed68b4-11fe-4291-bbe5-e4484ca859f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:00.885784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b8ed68b4-11fe-4291-bbe5-e4484ca859f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:00.886586 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b8ed68b4-11fe-4291-bbe5-e4484ca859f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:00.887027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b8ed68b4-11fe-4291-bbe5-e4484ca859f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:00.948428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b8ed68b4-11fe-4291-bbe5-e4484ca859f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:00.956568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b8ed68b4-11fe-4291-bbe5-e4484ca859f7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083433 Jun 02 16:23:00.957135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 674/1366] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:00 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:01.974927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7be3024d-7218-46d7-981c-2032acceb622 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:01.975707 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7be3024d-7218-46d7-981c-2032acceb622 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:01.982639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7be3024d-7218-46d7-981c-2032acceb622 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:01.983154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7be3024d-7218-46d7-981c-2032acceb622 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:01.987360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7be3024d-7218-46d7-981c-2032acceb622 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:01.987868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7be3024d-7218-46d7-981c-2032acceb622 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:02.050625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7be3024d-7218-46d7-981c-2032acceb622 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:02.057917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7be3024d-7218-46d7-981c-2032acceb622 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.088115 Jun 02 16:23:02.058514 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 693/1367] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:01 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:03.074823 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e2624dbe-e7d4-4718-99d7-983d87d3b533 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:03.075451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e2624dbe-e7d4-4718-99d7-983d87d3b533 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:03.082533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2624dbe-e7d4-4718-99d7-983d87d3b533 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:03.082980 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2624dbe-e7d4-4718-99d7-983d87d3b533 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:03.083739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2624dbe-e7d4-4718-99d7-983d87d3b533 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:03.084175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2624dbe-e7d4-4718-99d7-983d87d3b533 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:03.144966 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e2624dbe-e7d4-4718-99d7-983d87d3b533 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:03.152388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e2624dbe-e7d4-4718-99d7-983d87d3b533 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081429 Jun 02 16:23:03.152952 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 675/1368] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:03 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:04.169254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b0c1d3d9-f7d9-4a2c-be5b-df2fba34e982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:04.169843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b0c1d3d9-f7d9-4a2c-be5b-df2fba34e982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:04.176727 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0c1d3d9-f7d9-4a2c-be5b-df2fba34e982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:04.177169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0c1d3d9-f7d9-4a2c-be5b-df2fba34e982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:04.177926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0c1d3d9-f7d9-4a2c-be5b-df2fba34e982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:04.178380 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0c1d3d9-f7d9-4a2c-be5b-df2fba34e982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:04.241815 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b0c1d3d9-f7d9-4a2c-be5b-df2fba34e982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:04.249231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b0c1d3d9-f7d9-4a2c-be5b-df2fba34e982 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083874 Jun 02 16:23:04.249869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 694/1369] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:04 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:05.267304 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9bd4d8bb-0764-4ccd-93fc-6e037434cf7f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:05.267909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9bd4d8bb-0764-4ccd-93fc-6e037434cf7f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:05.274419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9bd4d8bb-0764-4ccd-93fc-6e037434cf7f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:05.274865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9bd4d8bb-0764-4ccd-93fc-6e037434cf7f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:05.275618 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9bd4d8bb-0764-4ccd-93fc-6e037434cf7f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:05.276049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9bd4d8bb-0764-4ccd-93fc-6e037434cf7f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:05.336367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9bd4d8bb-0764-4ccd-93fc-6e037434cf7f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:05.343759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9bd4d8bb-0764-4ccd-93fc-6e037434cf7f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080980 Jun 02 16:23:05.344314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 676/1370] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:06.360729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-59c37af3-f921-4634-9424-ce2a3ef0fc1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:06.363773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-59c37af3-f921-4634-9424-ce2a3ef0fc1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:06.367893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59c37af3-f921-4634-9424-ce2a3ef0fc1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:06.368347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59c37af3-f921-4634-9424-ce2a3ef0fc1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:06.369111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59c37af3-f921-4634-9424-ce2a3ef0fc1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:06.369552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59c37af3-f921-4634-9424-ce2a3ef0fc1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:06.436335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-59c37af3-f921-4634-9424-ce2a3ef0fc1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:06.443801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-59c37af3-f921-4634-9424-ce2a3ef0fc1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086963 Jun 02 16:23:06.444360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 695/1371] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:06 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:07.460846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c0109b28-f4f6-4a4a-92c4-d74d5f366313 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:07.461395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c0109b28-f4f6-4a4a-92c4-d74d5f366313 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:07.467916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0109b28-f4f6-4a4a-92c4-d74d5f366313 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:07.468896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0109b28-f4f6-4a4a-92c4-d74d5f366313 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:07.469672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0109b28-f4f6-4a4a-92c4-d74d5f366313 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:07.470138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0109b28-f4f6-4a4a-92c4-d74d5f366313 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:07.537201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c0109b28-f4f6-4a4a-92c4-d74d5f366313 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:07.544679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c0109b28-f4f6-4a4a-92c4-d74d5f366313 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087823 Jun 02 16:23:07.545260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 677/1372] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:07 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:08.562799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4aa2afe5-23ba-4a18-afe7-5d37370f4b9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:08.563415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4aa2afe5-23ba-4a18-afe7-5d37370f4b9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:08.569784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4aa2afe5-23ba-4a18-afe7-5d37370f4b9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:08.570262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4aa2afe5-23ba-4a18-afe7-5d37370f4b9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:08.571016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4aa2afe5-23ba-4a18-afe7-5d37370f4b9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:08.571443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4aa2afe5-23ba-4a18-afe7-5d37370f4b9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:08.632250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4aa2afe5-23ba-4a18-afe7-5d37370f4b9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:08.639736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4aa2afe5-23ba-4a18-afe7-5d37370f4b9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081555 Jun 02 16:23:08.640487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 696/1373] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:08 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:09.656495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9fc8e5d5-b327-439a-8007-7f421fd8ebb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:09.657041 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9fc8e5d5-b327-439a-8007-7f421fd8ebb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:09.663530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9fc8e5d5-b327-439a-8007-7f421fd8ebb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:09.663987 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9fc8e5d5-b327-439a-8007-7f421fd8ebb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:09.664752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9fc8e5d5-b327-439a-8007-7f421fd8ebb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:09.665188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9fc8e5d5-b327-439a-8007-7f421fd8ebb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:09.726725 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9fc8e5d5-b327-439a-8007-7f421fd8ebb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:09.734053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9fc8e5d5-b327-439a-8007-7f421fd8ebb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081837 Jun 02 16:23:09.734734 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 678/1374] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:09 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:10.751048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-85ee69e0-4c02-42ef-b4fb-88b827c4bc34 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:10.751614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-85ee69e0-4c02-42ef-b4fb-88b827c4bc34 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:10.757819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85ee69e0-4c02-42ef-b4fb-88b827c4bc34 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:10.758300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85ee69e0-4c02-42ef-b4fb-88b827c4bc34 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:10.759066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85ee69e0-4c02-42ef-b4fb-88b827c4bc34 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:10.759499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85ee69e0-4c02-42ef-b4fb-88b827c4bc34 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:10.819289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-85ee69e0-4c02-42ef-b4fb-88b827c4bc34 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:10.826702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-85ee69e0-4c02-42ef-b4fb-88b827c4bc34 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079592 Jun 02 16:23:10.827266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 697/1375] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:10.866803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:23:10.866970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:23:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:23:11.844761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3a578ee1-391a-481b-90a2-f6edf99e2079 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:11.845617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3a578ee1-391a-481b-90a2-f6edf99e2079 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:11.852180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3a578ee1-391a-481b-90a2-f6edf99e2079 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:11.852624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3a578ee1-391a-481b-90a2-f6edf99e2079 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:11.853375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3a578ee1-391a-481b-90a2-f6edf99e2079 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:11.853811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3a578ee1-391a-481b-90a2-f6edf99e2079 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:11.915065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3a578ee1-391a-481b-90a2-f6edf99e2079 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:11.923177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3a578ee1-391a-481b-90a2-f6edf99e2079 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083199 Jun 02 16:23:11.923743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 679/1376] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:12.360767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:23:12.361305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:23:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:23:12.939801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-546fddbb-f43b-46d3-a2ed-07976a486e60 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:12.940421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-546fddbb-f43b-46d3-a2ed-07976a486e60 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:12.947083 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-546fddbb-f43b-46d3-a2ed-07976a486e60 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:12.947538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-546fddbb-f43b-46d3-a2ed-07976a486e60 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:12.948304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-546fddbb-f43b-46d3-a2ed-07976a486e60 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:12.948744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-546fddbb-f43b-46d3-a2ed-07976a486e60 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:13.012055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-546fddbb-f43b-46d3-a2ed-07976a486e60 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:13.020318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-546fddbb-f43b-46d3-a2ed-07976a486e60 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084458 Jun 02 16:23:13.020887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 698/1377] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:14.036920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0e26207b-9986-4bdf-929e-6f5fe04e86c2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:14.037531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0e26207b-9986-4bdf-929e-6f5fe04e86c2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:14.044248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e26207b-9986-4bdf-929e-6f5fe04e86c2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:14.044729 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e26207b-9986-4bdf-929e-6f5fe04e86c2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:14.045493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e26207b-9986-4bdf-929e-6f5fe04e86c2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:14.045957 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e26207b-9986-4bdf-929e-6f5fe04e86c2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:14.106362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0e26207b-9986-4bdf-929e-6f5fe04e86c2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:14.114427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0e26207b-9986-4bdf-929e-6f5fe04e86c2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081429 Jun 02 16:23:14.114997 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 680/1378] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:15.130592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5c17ed78-5fb9-4a45-bc70-037af1ad7869 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:15.131244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5c17ed78-5fb9-4a45-bc70-037af1ad7869 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:15.137722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5c17ed78-5fb9-4a45-bc70-037af1ad7869 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:15.138197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5c17ed78-5fb9-4a45-bc70-037af1ad7869 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:15.138951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5c17ed78-5fb9-4a45-bc70-037af1ad7869 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:15.139381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5c17ed78-5fb9-4a45-bc70-037af1ad7869 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:15.199763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5c17ed78-5fb9-4a45-bc70-037af1ad7869 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:15.207964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5c17ed78-5fb9-4a45-bc70-037af1ad7869 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081337 Jun 02 16:23:15.208514 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 699/1379] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:16.225076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d723a190-f689-41d7-874e-3dba8aeb17b9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:16.225757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d723a190-f689-41d7-874e-3dba8aeb17b9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:16.232265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d723a190-f689-41d7-874e-3dba8aeb17b9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:16.232719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d723a190-f689-41d7-874e-3dba8aeb17b9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:16.233486 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d723a190-f689-41d7-874e-3dba8aeb17b9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:16.233927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d723a190-f689-41d7-874e-3dba8aeb17b9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:16.298468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d723a190-f689-41d7-874e-3dba8aeb17b9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:16.305913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d723a190-f689-41d7-874e-3dba8aeb17b9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084673 Jun 02 16:23:16.306587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 681/1380] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:16 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:17.323552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-707fb041-fbfa-4756-9291-03e8e47400b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:17.324195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-707fb041-fbfa-4756-9291-03e8e47400b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:17.331655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-707fb041-fbfa-4756-9291-03e8e47400b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:17.332110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-707fb041-fbfa-4756-9291-03e8e47400b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:17.332876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-707fb041-fbfa-4756-9291-03e8e47400b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:17.333320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-707fb041-fbfa-4756-9291-03e8e47400b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:17.394342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-707fb041-fbfa-4756-9291-03e8e47400b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:17.401790 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-707fb041-fbfa-4756-9291-03e8e47400b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082094 Jun 02 16:23:17.402383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 700/1381] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:17 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:18.418874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cc33222a-6ea0-4f2c-8e10-072767cf6d18 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:18.419429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cc33222a-6ea0-4f2c-8e10-072767cf6d18 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:18.426265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc33222a-6ea0-4f2c-8e10-072767cf6d18 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:18.426720 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc33222a-6ea0-4f2c-8e10-072767cf6d18 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:18.427484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc33222a-6ea0-4f2c-8e10-072767cf6d18 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:18.427924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc33222a-6ea0-4f2c-8e10-072767cf6d18 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:18.489629 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cc33222a-6ea0-4f2c-8e10-072767cf6d18 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:18.497205 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cc33222a-6ea0-4f2c-8e10-072767cf6d18 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082282 Jun 02 16:23:18.497769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 682/1382] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:18 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:19.515190 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9bccd22d-21e5-4232-abb5-601ff9de4479 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:19.515718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9bccd22d-21e5-4232-abb5-601ff9de4479 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:19.522187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9bccd22d-21e5-4232-abb5-601ff9de4479 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:19.522634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9bccd22d-21e5-4232-abb5-601ff9de4479 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:19.523392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9bccd22d-21e5-4232-abb5-601ff9de4479 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:19.523823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9bccd22d-21e5-4232-abb5-601ff9de4479 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:19.583586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9bccd22d-21e5-4232-abb5-601ff9de4479 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:19.590916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9bccd22d-21e5-4232-abb5-601ff9de4479 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079838 Jun 02 16:23:19.591471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 701/1383] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:20.609191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-06214e74-4cd0-43bf-b8d3-b99a3f65325f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:20.609851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-06214e74-4cd0-43bf-b8d3-b99a3f65325f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:20.616972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06214e74-4cd0-43bf-b8d3-b99a3f65325f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:20.617425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06214e74-4cd0-43bf-b8d3-b99a3f65325f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:20.618231 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06214e74-4cd0-43bf-b8d3-b99a3f65325f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:20.618674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06214e74-4cd0-43bf-b8d3-b99a3f65325f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:20.681587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-06214e74-4cd0-43bf-b8d3-b99a3f65325f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:20.689003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-06214e74-4cd0-43bf-b8d3-b99a3f65325f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083661 Jun 02 16:23:20.689561 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 683/1384] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:20 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:21.706953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a3a99196-32b6-489d-94da-27f3428d30fa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:21.707521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a3a99196-32b6-489d-94da-27f3428d30fa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:21.713966 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a3a99196-32b6-489d-94da-27f3428d30fa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:21.714458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a3a99196-32b6-489d-94da-27f3428d30fa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:21.715220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a3a99196-32b6-489d-94da-27f3428d30fa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:21.715653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a3a99196-32b6-489d-94da-27f3428d30fa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:21.781774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a3a99196-32b6-489d-94da-27f3428d30fa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:21.790273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a3a99196-32b6-489d-94da-27f3428d30fa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087620 Jun 02 16:23:21.790837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 702/1385] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:22.807979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0dd384bd-78a8-48a3-87ff-d82b27f97fa6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:22.808596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0dd384bd-78a8-48a3-87ff-d82b27f97fa6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:22.815188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0dd384bd-78a8-48a3-87ff-d82b27f97fa6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:22.816206 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0dd384bd-78a8-48a3-87ff-d82b27f97fa6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:22.816977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0dd384bd-78a8-48a3-87ff-d82b27f97fa6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:22.817414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0dd384bd-78a8-48a3-87ff-d82b27f97fa6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:22.877332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0dd384bd-78a8-48a3-87ff-d82b27f97fa6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:22.884814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0dd384bd-78a8-48a3-87ff-d82b27f97fa6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080724 Jun 02 16:23:22.887559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 684/1386] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:23.902564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-80eaae31-4bda-41ba-bfed-c9d15903bbbf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:23.903243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-80eaae31-4bda-41ba-bfed-c9d15903bbbf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:23.910523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80eaae31-4bda-41ba-bfed-c9d15903bbbf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:23.910964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80eaae31-4bda-41ba-bfed-c9d15903bbbf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:23.911711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80eaae31-4bda-41ba-bfed-c9d15903bbbf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:23.912141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80eaae31-4bda-41ba-bfed-c9d15903bbbf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:23.914641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:23.978124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-80eaae31-4bda-41ba-bfed-c9d15903bbbf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:23.985800 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-80eaae31-4bda-41ba-bfed-c9d15903bbbf tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087111 Jun 02 16:23:23.986574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 703/1387] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:23 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:25.004315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-653286af-cc55-41ea-bbe8-db8f4a0ac0b5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:25.004921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-653286af-cc55-41ea-bbe8-db8f4a0ac0b5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:25.011336 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-653286af-cc55-41ea-bbe8-db8f4a0ac0b5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:25.011774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-653286af-cc55-41ea-bbe8-db8f4a0ac0b5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:25.012530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-653286af-cc55-41ea-bbe8-db8f4a0ac0b5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:25.013038 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-653286af-cc55-41ea-bbe8-db8f4a0ac0b5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:25.077092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-653286af-cc55-41ea-bbe8-db8f4a0ac0b5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:25.085082 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-653286af-cc55-41ea-bbe8-db8f4a0ac0b5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085460 Jun 02 16:23:25.085642 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 685/1388] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:24 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:26.102206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2c3c0972-0bc9-41d0-98c7-e64cea3e2da0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:26.102813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2c3c0972-0bc9-41d0-98c7-e64cea3e2da0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:26.105209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=30 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:26.109898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c3c0972-0bc9-41d0-98c7-e64cea3e2da0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:26.110392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c3c0972-0bc9-41d0-98c7-e64cea3e2da0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:26.111145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c3c0972-0bc9-41d0-98c7-e64cea3e2da0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:26.111725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c3c0972-0bc9-41d0-98c7-e64cea3e2da0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:26.173269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2c3c0972-0bc9-41d0-98c7-e64cea3e2da0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:26.181146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2c3c0972-0bc9-41d0-98c7-e64cea3e2da0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082805 Jun 02 16:23:26.181707 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 704/1389] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:26 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:26.471471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:23:26.472056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:23:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:23:27.199261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2543348f-a353-416b-b796-8a7db4f3ad39 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:27.199879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2543348f-a353-416b-b796-8a7db4f3ad39 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:27.206547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2543348f-a353-416b-b796-8a7db4f3ad39 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:27.207002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2543348f-a353-416b-b796-8a7db4f3ad39 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:27.207792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2543348f-a353-416b-b796-8a7db4f3ad39 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:27.208228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2543348f-a353-416b-b796-8a7db4f3ad39 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:27.268874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2543348f-a353-416b-b796-8a7db4f3ad39 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:27.276299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2543348f-a353-416b-b796-8a7db4f3ad39 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080998 Jun 02 16:23:27.276856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 686/1390] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:27 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:28.293001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b3fdcf37-ca0f-451a-b95c-ae631ef0d955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:28.293652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b3fdcf37-ca0f-451a-b95c-ae631ef0d955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:28.300205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcf37-ca0f-451a-b95c-ae631ef0d955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:28.300657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcf37-ca0f-451a-b95c-ae631ef0d955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:28.301420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcf37-ca0f-451a-b95c-ae631ef0d955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:28.301862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcf37-ca0f-451a-b95c-ae631ef0d955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:28.361946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b3fdcf37-ca0f-451a-b95c-ae631ef0d955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:28.369381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b3fdcf37-ca0f-451a-b95c-ae631ef0d955 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080204 Jun 02 16:23:28.369944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 705/1391] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:28 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:29.387033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c5b034d0-656b-4a3b-ade3-243260b8ffb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:29.387635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c5b034d0-656b-4a3b-ade3-243260b8ffb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:29.389945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:29.395415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c5b034d0-656b-4a3b-ade3-243260b8ffb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:29.395864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c5b034d0-656b-4a3b-ade3-243260b8ffb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:29.396633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c5b034d0-656b-4a3b-ade3-243260b8ffb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:29.397068 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c5b034d0-656b-4a3b-ade3-243260b8ffb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:29.457815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c5b034d0-656b-4a3b-ade3-243260b8ffb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:29.465331 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c5b034d0-656b-4a3b-ade3-243260b8ffb4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082192 Jun 02 16:23:29.465890 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 687/1392] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:29 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:30.482549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e90370d8-4f51-43cb-a422-013e3af294ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:30.483664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e90370d8-4f51-43cb-a422-013e3af294ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:30.489769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e90370d8-4f51-43cb-a422-013e3af294ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:30.490257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e90370d8-4f51-43cb-a422-013e3af294ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:30.491057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e90370d8-4f51-43cb-a422-013e3af294ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:30.491496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e90370d8-4f51-43cb-a422-013e3af294ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:30.554881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e90370d8-4f51-43cb-a422-013e3af294ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:30.562372 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e90370d8-4f51-43cb-a422-013e3af294ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083681 Jun 02 16:23:30.562938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 706/1393] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:30 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:31.579595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-45c6e6d8-34a3-40e4-8c99-b1e718ae3243 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:31.580273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-45c6e6d8-34a3-40e4-8c99-b1e718ae3243 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:31.586522 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45c6e6d8-34a3-40e4-8c99-b1e718ae3243 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:31.589963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45c6e6d8-34a3-40e4-8c99-b1e718ae3243 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:31.589963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45c6e6d8-34a3-40e4-8c99-b1e718ae3243 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:31.589963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45c6e6d8-34a3-40e4-8c99-b1e718ae3243 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:31.590816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=90 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:31.652521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-45c6e6d8-34a3-40e4-8c99-b1e718ae3243 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:31.661911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-45c6e6d8-34a3-40e4-8c99-b1e718ae3243 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086044 Jun 02 16:23:31.664592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 688/1394] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:31 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:32.680521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ee149e45-e574-4d6d-afbc-f24353c1c8d3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:32.681300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ee149e45-e574-4d6d-afbc-f24353c1c8d3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:32.688222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee149e45-e574-4d6d-afbc-f24353c1c8d3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:32.688760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee149e45-e574-4d6d-afbc-f24353c1c8d3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:32.690345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee149e45-e574-4d6d-afbc-f24353c1c8d3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:32.690808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee149e45-e574-4d6d-afbc-f24353c1c8d3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:32.758233 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ee149e45-e574-4d6d-afbc-f24353c1c8d3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:32.764975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ee149e45-e574-4d6d-afbc-f24353c1c8d3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.089001 Jun 02 16:23:32.765534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 707/1395] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:32 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:33.782358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ea344bb2-538e-43de-8017-b2a86ef5ed2e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:33.783868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ea344bb2-538e-43de-8017-b2a86ef5ed2e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:33.790175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea344bb2-538e-43de-8017-b2a86ef5ed2e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:33.790623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea344bb2-538e-43de-8017-b2a86ef5ed2e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:33.791383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea344bb2-538e-43de-8017-b2a86ef5ed2e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:33.791818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ea344bb2-538e-43de-8017-b2a86ef5ed2e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:33.856664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ea344bb2-538e-43de-8017-b2a86ef5ed2e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:33.865135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ea344bb2-538e-43de-8017-b2a86ef5ed2e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086898 Jun 02 16:23:33.865706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 689/1396] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:33 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:34.882066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8b7d8ea6-d6ad-482c-b0fb-070b0edaa715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:34.882621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8b7d8ea6-d6ad-482c-b0fb-070b0edaa715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:34.889081 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b7d8ea6-d6ad-482c-b0fb-070b0edaa715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:34.889518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b7d8ea6-d6ad-482c-b0fb-070b0edaa715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:34.890297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b7d8ea6-d6ad-482c-b0fb-070b0edaa715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:34.890724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8b7d8ea6-d6ad-482c-b0fb-070b0edaa715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:34.952846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8b7d8ea6-d6ad-482c-b0fb-070b0edaa715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:34.961113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8b7d8ea6-d6ad-482c-b0fb-070b0edaa715 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082968 Jun 02 16:23:34.961666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 708/1397] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:34 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:35.979666 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-830421e4-439a-4093-b20a-19a195348f3b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:35.980201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-830421e4-439a-4093-b20a-19a195348f3b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:35.987517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-830421e4-439a-4093-b20a-19a195348f3b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:35.987963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-830421e4-439a-4093-b20a-19a195348f3b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:35.988724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-830421e4-439a-4093-b20a-19a195348f3b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:35.989159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-830421e4-439a-4093-b20a-19a195348f3b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:36.051191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-830421e4-439a-4093-b20a-19a195348f3b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:36.058630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-830421e4-439a-4093-b20a-19a195348f3b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082937 Jun 02 16:23:36.059194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 690/1398] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:35 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:37.138910 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cb0f7585-eb98-4abd-a785-d0c1c03f1624 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:37.139524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cb0f7585-eb98-4abd-a785-d0c1c03f1624 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:37.145792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7585-eb98-4abd-a785-d0c1c03f1624 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:37.146279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7585-eb98-4abd-a785-d0c1c03f1624 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:37.147040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7585-eb98-4abd-a785-d0c1c03f1624 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:37.147489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7585-eb98-4abd-a785-d0c1c03f1624 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:37.208754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cb0f7585-eb98-4abd-a785-d0c1c03f1624 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:37.216198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cb0f7585-eb98-4abd-a785-d0c1c03f1624 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.144585 Jun 02 16:23:37.216752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 709/1399] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:37 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:38.233120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-127cbba2-d6c9-4954-8b8b-fbc8130c30ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:38.233721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-127cbba2-d6c9-4954-8b8b-fbc8130c30ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:38.240194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-127cbba2-d6c9-4954-8b8b-fbc8130c30ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:38.240637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-127cbba2-d6c9-4954-8b8b-fbc8130c30ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:38.241388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-127cbba2-d6c9-4954-8b8b-fbc8130c30ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:38.241814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-127cbba2-d6c9-4954-8b8b-fbc8130c30ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:38.301927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-127cbba2-d6c9-4954-8b8b-fbc8130c30ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:38.309317 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-127cbba2-d6c9-4954-8b8b-fbc8130c30ca tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080102 Jun 02 16:23:38.309874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 691/1400] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:38 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:39.326681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f89ba291-dd71-4375-b538-69e1320854aa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:39.327295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f89ba291-dd71-4375-b538-69e1320854aa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:39.334445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f89ba291-dd71-4375-b538-69e1320854aa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:39.334897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f89ba291-dd71-4375-b538-69e1320854aa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:39.335688 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f89ba291-dd71-4375-b538-69e1320854aa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:39.336131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f89ba291-dd71-4375-b538-69e1320854aa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:39.399335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f89ba291-dd71-4375-b538-69e1320854aa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:39.406868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f89ba291-dd71-4375-b538-69e1320854aa tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084088 Jun 02 16:23:39.407431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 710/1401] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:39 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:40.425203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-41cd3368-1088-4248-a710-613b53a352c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:40.425907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-41cd3368-1088-4248-a710-613b53a352c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:40.432477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41cd3368-1088-4248-a710-613b53a352c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:40.432923 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41cd3368-1088-4248-a710-613b53a352c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:40.433689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41cd3368-1088-4248-a710-613b53a352c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:40.434146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41cd3368-1088-4248-a710-613b53a352c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:40.495231 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-41cd3368-1088-4248-a710-613b53a352c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:40.502862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-41cd3368-1088-4248-a710-613b53a352c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082161 Jun 02 16:23:40.503565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 692/1402] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:40 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:41.519827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3ee8691f-bcd7-45bc-954a-4e2b44e2ea87 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:41.520377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3ee8691f-bcd7-45bc-954a-4e2b44e2ea87 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:41.526361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee8691f-bcd7-45bc-954a-4e2b44e2ea87 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:41.526815 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee8691f-bcd7-45bc-954a-4e2b44e2ea87 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:41.527573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee8691f-bcd7-45bc-954a-4e2b44e2ea87 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:41.528009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee8691f-bcd7-45bc-954a-4e2b44e2ea87 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:41.589210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3ee8691f-bcd7-45bc-954a-4e2b44e2ea87 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:41.604470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3ee8691f-bcd7-45bc-954a-4e2b44e2ea87 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081372 Jun 02 16:23:41.604470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 711/1403] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:41 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:23:41.807579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c8494c4a-6ee0-487f-8f16-9b0852045dfb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:41.808078 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c8494c4a-6ee0-487f-8f16-9b0852045dfb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:41.815614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8494c4a-6ee0-487f-8f16-9b0852045dfb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:41.816088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8494c4a-6ee0-487f-8f16-9b0852045dfb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:41.816854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8494c4a-6ee0-487f-8f16-9b0852045dfb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:41.817302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8494c4a-6ee0-487f-8f16-9b0852045dfb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:42.618284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-09e4f659-8083-481c-9663-eb063b4f9978 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:42.618923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-09e4f659-8083-481c-9663-eb063b4f9978 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:42.625352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09e4f659-8083-481c-9663-eb063b4f9978 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:42.625802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09e4f659-8083-481c-9663-eb063b4f9978 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:42.626584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09e4f659-8083-481c-9663-eb063b4f9978 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:42.627018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09e4f659-8083-481c-9663-eb063b4f9978 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:42.687673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-09e4f659-8083-481c-9663-eb063b4f9978 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:42.696090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-09e4f659-8083-481c-9663-eb063b4f9978 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081610 Jun 02 16:23:42.696650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 712/1404] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:42 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:42.947864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-68431b03-365c-42bb-8a30-443eae4bf0b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:42.948798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-68431b03-365c-42bb-8a30-443eae4bf0b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:42.955023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68431b03-365c-42bb-8a30-443eae4bf0b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:42.955478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68431b03-365c-42bb-8a30-443eae4bf0b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:42.956892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68431b03-365c-42bb-8a30-443eae4bf0b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:42.957338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68431b03-365c-42bb-8a30-443eae4bf0b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:42.984731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-c8494c4a-6ee0-487f-8f16-9b0852045dfb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lazy-loading 'services' on Instance uuid 6d9f21d8-cd12-4d8c-8dc7-765453991dcb {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:23:42.987961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-68431b03-365c-42bb-8a30-443eae4bf0b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043855 Jun 02 16:23:42.991854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 713/1405] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:23:43.713264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-da9cbc63-35ee-49a0-b490-59bd382a22ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:43.713926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-da9cbc63-35ee-49a0-b490-59bd382a22ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:43.720748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da9cbc63-35ee-49a0-b490-59bd382a22ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:43.721197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da9cbc63-35ee-49a0-b490-59bd382a22ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:43.721955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da9cbc63-35ee-49a0-b490-59bd382a22ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:43.722417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-da9cbc63-35ee-49a0-b490-59bd382a22ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:43.783094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-da9cbc63-35ee-49a0-b490-59bd382a22ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:43.791190 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-da9cbc63-35ee-49a0-b490-59bd382a22ef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081765 Jun 02 16:23:43.791748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 714/1406] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:43 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:43.999599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-583d2b2d-e692-4fba-8ecb-574dbb7d933d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:44.000476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-583d2b2d-e692-4fba-8ecb-574dbb7d933d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:44.006999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-583d2b2d-e692-4fba-8ecb-574dbb7d933d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:44.007448 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-583d2b2d-e692-4fba-8ecb-574dbb7d933d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:44.008204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-583d2b2d-e692-4fba-8ecb-574dbb7d933d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:44.008638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-583d2b2d-e692-4fba-8ecb-574dbb7d933d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:44.037582 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-583d2b2d-e692-4fba-8ecb-574dbb7d933d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041892 Jun 02 16:23:44.038142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 715/1407] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:43 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:23:44.807960 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e486d5c8-69e4-4dbc-a010-6708309d1121 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:44.808620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e486d5c8-69e4-4dbc-a010-6708309d1121 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:44.814932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e486d5c8-69e4-4dbc-a010-6708309d1121 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:44.815379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e486d5c8-69e4-4dbc-a010-6708309d1121 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:44.816130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e486d5c8-69e4-4dbc-a010-6708309d1121 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:44.816560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e486d5c8-69e4-4dbc-a010-6708309d1121 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:44.881247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e486d5c8-69e4-4dbc-a010-6708309d1121 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:44.888847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e486d5c8-69e4-4dbc-a010-6708309d1121 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084773 Jun 02 16:23:44.889443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 716/1408] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:44 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:45.049208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5a874e89-5624-4316-99d3-e6ea3d915f8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:45.050221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5a874e89-5624-4316-99d3-e6ea3d915f8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:45.056748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a874e89-5624-4316-99d3-e6ea3d915f8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:45.057199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a874e89-5624-4316-99d3-e6ea3d915f8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:45.058014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a874e89-5624-4316-99d3-e6ea3d915f8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:45.058429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a874e89-5624-4316-99d3-e6ea3d915f8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:45.087711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5a874e89-5624-4316-99d3-e6ea3d915f8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 Jun 02 16:23:45.088259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 717/1409] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:23:45.905601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ca10681e-6cb8-45fd-83ed-2f81eaaf5f73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:45.906291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ca10681e-6cb8-45fd-83ed-2f81eaaf5f73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:45.913084 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca10681e-6cb8-45fd-83ed-2f81eaaf5f73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:45.913538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca10681e-6cb8-45fd-83ed-2f81eaaf5f73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:45.914329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca10681e-6cb8-45fd-83ed-2f81eaaf5f73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:45.914772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca10681e-6cb8-45fd-83ed-2f81eaaf5f73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:45.977993 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ca10681e-6cb8-45fd-83ed-2f81eaaf5f73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:45.986729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ca10681e-6cb8-45fd-83ed-2f81eaaf5f73 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085008 Jun 02 16:23:45.987293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 718/1410] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:45 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:46.101137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d751f1eb-3e72-4df3-a029-14fb614bd227 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:46.102111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d751f1eb-3e72-4df3-a029-14fb614bd227 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:46.108056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d751f1eb-3e72-4df3-a029-14fb614bd227 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:46.108507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d751f1eb-3e72-4df3-a029-14fb614bd227 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:46.109263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d751f1eb-3e72-4df3-a029-14fb614bd227 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:46.109700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d751f1eb-3e72-4df3-a029-14fb614bd227 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:46.134700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:46.139059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d751f1eb-3e72-4df3-a029-14fb614bd227 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043703 Jun 02 16:23:46.139600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 719/1411] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:23:47.004947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-43c38a1d-bfa9-47e1-b26f-9a57c826b6ac tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:47.005626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-43c38a1d-bfa9-47e1-b26f-9a57c826b6ac tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:47.012247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43c38a1d-bfa9-47e1-b26f-9a57c826b6ac tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:47.012863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43c38a1d-bfa9-47e1-b26f-9a57c826b6ac tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:47.013622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43c38a1d-bfa9-47e1-b26f-9a57c826b6ac tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:47.014060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43c38a1d-bfa9-47e1-b26f-9a57c826b6ac tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:47.075395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-43c38a1d-bfa9-47e1-b26f-9a57c826b6ac tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:47.083713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-43c38a1d-bfa9-47e1-b26f-9a57c826b6ac tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083026 Jun 02 16:23:47.084276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 720/1412] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:46 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:47.159222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b35c3fc6-e28a-477e-8060-90cfad474051 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:47.160397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b35c3fc6-e28a-477e-8060-90cfad474051 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:47.166466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b35c3fc6-e28a-477e-8060-90cfad474051 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:47.166918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b35c3fc6-e28a-477e-8060-90cfad474051 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:47.167689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b35c3fc6-e28a-477e-8060-90cfad474051 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:47.168127 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b35c3fc6-e28a-477e-8060-90cfad474051 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:47.198136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b35c3fc6-e28a-477e-8060-90cfad474051 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042750 Jun 02 16:23:47.198771 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 721/1413] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:47 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:23:48.101398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7bbe73b3-ea3e-4f3f-a1c4-8d2570c52d2b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:48.102016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7bbe73b3-ea3e-4f3f-a1c4-8d2570c52d2b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:48.108436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7bbe73b3-ea3e-4f3f-a1c4-8d2570c52d2b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:48.108888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7bbe73b3-ea3e-4f3f-a1c4-8d2570c52d2b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:48.109652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7bbe73b3-ea3e-4f3f-a1c4-8d2570c52d2b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:48.110107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7bbe73b3-ea3e-4f3f-a1c4-8d2570c52d2b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:48.171562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7bbe73b3-ea3e-4f3f-a1c4-8d2570c52d2b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:48.180997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7bbe73b3-ea3e-4f3f-a1c4-8d2570c52d2b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084165 Jun 02 16:23:48.181598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 722/1414] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:48 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:48.209302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-82908e24-5315-4c80-8b44-6eb6e5b9735c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:48.210249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-82908e24-5315-4c80-8b44-6eb6e5b9735c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:48.216157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-82908e24-5315-4c80-8b44-6eb6e5b9735c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:48.216611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-82908e24-5315-4c80-8b44-6eb6e5b9735c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:48.217372 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-82908e24-5315-4c80-8b44-6eb6e5b9735c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:48.217808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-82908e24-5315-4c80-8b44-6eb6e5b9735c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:48.246789 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-82908e24-5315-4c80-8b44-6eb6e5b9735c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Jun 02 16:23:48.247329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 723/1415] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:48 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:23:49.198264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bce59e25-6ea7-4753-be81-f559a26dadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:49.198927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bce59e25-6ea7-4753-be81-f559a26dadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:49.205307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bce59e25-6ea7-4753-be81-f559a26dadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:49.205759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bce59e25-6ea7-4753-be81-f559a26dadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:49.206561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bce59e25-6ea7-4753-be81-f559a26dadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:49.207111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bce59e25-6ea7-4753-be81-f559a26dadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:49.274763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bce59e25-6ea7-4753-be81-f559a26dadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:49.282276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bce59e25-6ea7-4753-be81-f559a26dadf0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087857 Jun 02 16:23:49.282835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 724/1416] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:49 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:49.288278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-17220e07-4d88-4fb6-9340-175639453f81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:49.289180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-17220e07-4d88-4fb6-9340-175639453f81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:49.294747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-17220e07-4d88-4fb6-9340-175639453f81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:49.295196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-17220e07-4d88-4fb6-9340-175639453f81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:49.295986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-17220e07-4d88-4fb6-9340-175639453f81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:49.296422 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-17220e07-4d88-4fb6-9340-175639453f81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:49.325153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-17220e07-4d88-4fb6-9340-175639453f81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041348 Jun 02 16:23:49.325697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 725/1417] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:23:50.299059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-701a0903-ab38-4a4c-98e2-008915fbb94d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:50.299673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-701a0903-ab38-4a4c-98e2-008915fbb94d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:50.306986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-701a0903-ab38-4a4c-98e2-008915fbb94d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:50.307438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-701a0903-ab38-4a4c-98e2-008915fbb94d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:50.308202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-701a0903-ab38-4a4c-98e2-008915fbb94d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:50.308640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-701a0903-ab38-4a4c-98e2-008915fbb94d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:50.372009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-701a0903-ab38-4a4c-98e2-008915fbb94d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:50.380274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-701a0903-ab38-4a4c-98e2-008915fbb94d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085121 Jun 02 16:23:50.380825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 726/1418] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:50 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:50.385324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dbeb1618-8c90-450d-b49f-70f0f67fb861 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:50.386390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dbeb1618-8c90-450d-b49f-70f0f67fb861 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:50.392038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dbeb1618-8c90-450d-b49f-70f0f67fb861 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:50.392487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dbeb1618-8c90-450d-b49f-70f0f67fb861 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:50.393249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dbeb1618-8c90-450d-b49f-70f0f67fb861 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:50.393684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dbeb1618-8c90-450d-b49f-70f0f67fb861 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:50.422412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dbeb1618-8c90-450d-b49f-70f0f67fb861 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040514 Jun 02 16:23:50.422962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 727/1419] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:23:51.397342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9457e1dc-cb2f-4bf8-b785-cf5a536101c3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:51.397950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9457e1dc-cb2f-4bf8-b785-cf5a536101c3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:51.404353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9457e1dc-cb2f-4bf8-b785-cf5a536101c3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:51.404799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9457e1dc-cb2f-4bf8-b785-cf5a536101c3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:51.405548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9457e1dc-cb2f-4bf8-b785-cf5a536101c3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:51.405977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9457e1dc-cb2f-4bf8-b785-cf5a536101c3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:51.468006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9457e1dc-cb2f-4bf8-b785-cf5a536101c3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:51.476877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9457e1dc-cb2f-4bf8-b785-cf5a536101c3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083429 Jun 02 16:23:51.477441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 728/1420] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:51 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:51.485437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b3bfc8e7-ef8f-48ee-94f4-02abad019fdb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:51.485437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b3bfc8e7-ef8f-48ee-94f4-02abad019fdb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:51.489346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3bfc8e7-ef8f-48ee-94f4-02abad019fdb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:51.489783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3bfc8e7-ef8f-48ee-94f4-02abad019fdb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:51.490566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3bfc8e7-ef8f-48ee-94f4-02abad019fdb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:51.490994 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3bfc8e7-ef8f-48ee-94f4-02abad019fdb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:51.519661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b3bfc8e7-ef8f-48ee-94f4-02abad019fdb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041150 Jun 02 16:23:51.520121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 729/1421] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:23:51.813047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=13 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:52.494281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7e824d9e-337e-40da-b17f-3890bc8f7c61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:52.494664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7e824d9e-337e-40da-b17f-3890bc8f7c61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:52.500875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e824d9e-337e-40da-b17f-3890bc8f7c61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:52.501316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e824d9e-337e-40da-b17f-3890bc8f7c61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:52.502065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e824d9e-337e-40da-b17f-3890bc8f7c61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:52.502517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e824d9e-337e-40da-b17f-3890bc8f7c61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:52.564827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7e824d9e-337e-40da-b17f-3890bc8f7c61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:52.573877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7e824d9e-337e-40da-b17f-3890bc8f7c61 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083863 Jun 02 16:23:52.574473 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 730/1422] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:52 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:52.579108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dc3b4a2d-09c9-4450-a1f4-39d891bc0dd5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:52.580010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dc3b4a2d-09c9-4450-a1f4-39d891bc0dd5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:52.585773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc3b4a2d-09c9-4450-a1f4-39d891bc0dd5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:52.586249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc3b4a2d-09c9-4450-a1f4-39d891bc0dd5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:52.587003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc3b4a2d-09c9-4450-a1f4-39d891bc0dd5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:52.587539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc3b4a2d-09c9-4450-a1f4-39d891bc0dd5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:52.616257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dc3b4a2d-09c9-4450-a1f4-39d891bc0dd5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040821 Jun 02 16:23:52.616791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 731/1423] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:52 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:23:52.990225 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=37 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:53.590851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-697fa2cc-b105-4ed2-a680-4971388e7cd9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:53.591451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-697fa2cc-b105-4ed2-a680-4971388e7cd9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:53.599420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-697fa2cc-b105-4ed2-a680-4971388e7cd9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:53.599873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-697fa2cc-b105-4ed2-a680-4971388e7cd9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:53.600635 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-697fa2cc-b105-4ed2-a680-4971388e7cd9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:53.601070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-697fa2cc-b105-4ed2-a680-4971388e7cd9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:53.666630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-697fa2cc-b105-4ed2-a680-4971388e7cd9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:53.674145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-697fa2cc-b105-4ed2-a680-4971388e7cd9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.087136 Jun 02 16:23:53.674699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 732/1424] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:53 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:53.679203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f0489ae6-d6b7-4ed2-ad70-952b05288549 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:53.680099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f0489ae6-d6b7-4ed2-ad70-952b05288549 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:53.685965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0489ae6-d6b7-4ed2-ad70-952b05288549 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:53.686451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0489ae6-d6b7-4ed2-ad70-952b05288549 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:53.687215 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0489ae6-d6b7-4ed2-ad70-952b05288549 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:53.687654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0489ae6-d6b7-4ed2-ad70-952b05288549 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:53.717474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f0489ae6-d6b7-4ed2-ad70-952b05288549 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041728 Jun 02 16:23:53.718011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 733/1425] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:53 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:23:54.690488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8eeb89e0-a754-4e07-8750-15853da0dcb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:54.691216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8eeb89e0-a754-4e07-8750-15853da0dcb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:54.697604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8eeb89e0-a754-4e07-8750-15853da0dcb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:54.698044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8eeb89e0-a754-4e07-8750-15853da0dcb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:54.698822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8eeb89e0-a754-4e07-8750-15853da0dcb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:54.699253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8eeb89e0-a754-4e07-8750-15853da0dcb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:54.760132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8eeb89e0-a754-4e07-8750-15853da0dcb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:54.767742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8eeb89e0-a754-4e07-8750-15853da0dcb7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081066 Jun 02 16:23:54.768298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 734/1426] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:54 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:54.772894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f2a0d0af-11b1-4971-8dfc-e1f7a34057ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:54.773830 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f2a0d0af-11b1-4971-8dfc-e1f7a34057ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:54.779377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2a0d0af-11b1-4971-8dfc-e1f7a34057ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:54.779816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2a0d0af-11b1-4971-8dfc-e1f7a34057ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:54.780564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2a0d0af-11b1-4971-8dfc-e1f7a34057ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:54.780992 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2a0d0af-11b1-4971-8dfc-e1f7a34057ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:54.809988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f2a0d0af-11b1-4971-8dfc-e1f7a34057ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040691 Jun 02 16:23:54.810559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 735/1427] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:54 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:23:55.785366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f35c4004-6c72-4cc4-8981-07ebb7ca1f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:55.786177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f35c4004-6c72-4cc4-8981-07ebb7ca1f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:55.792464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f35c4004-6c72-4cc4-8981-07ebb7ca1f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:55.792911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f35c4004-6c72-4cc4-8981-07ebb7ca1f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:55.793685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f35c4004-6c72-4cc4-8981-07ebb7ca1f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:55.794154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f35c4004-6c72-4cc4-8981-07ebb7ca1f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:55.809660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:55.857395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f35c4004-6c72-4cc4-8981-07ebb7ca1f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:55.865182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f35c4004-6c72-4cc4-8981-07ebb7ca1f5c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084296 Jun 02 16:23:55.865744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 736/1428] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:55 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:55.870345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f77b924e-22a2-4745-b18d-30fd91664153 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:55.871247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f77b924e-22a2-4745-b18d-30fd91664153 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:55.877061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f77b924e-22a2-4745-b18d-30fd91664153 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:55.877508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f77b924e-22a2-4745-b18d-30fd91664153 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:55.878462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f77b924e-22a2-4745-b18d-30fd91664153 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:55.879023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f77b924e-22a2-4745-b18d-30fd91664153 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:55.907516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f77b924e-22a2-4745-b18d-30fd91664153 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040789 Jun 02 16:23:55.908051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 737/1429] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:23:56.882618 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-42761c70-b8d1-41ea-bfc6-4366ff959263 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:56.883269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-42761c70-b8d1-41ea-bfc6-4366ff959263 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:56.885447 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=68 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:23:56.890187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42761c70-b8d1-41ea-bfc6-4366ff959263 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:56.890640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42761c70-b8d1-41ea-bfc6-4366ff959263 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:56.891402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42761c70-b8d1-41ea-bfc6-4366ff959263 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:56.891839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42761c70-b8d1-41ea-bfc6-4366ff959263 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:56.952695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-42761c70-b8d1-41ea-bfc6-4366ff959263 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:56.960684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-42761c70-b8d1-41ea-bfc6-4366ff959263 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082627 Jun 02 16:23:56.961244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 738/1430] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:56 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:56.965827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4d7ba7b9-3b99-419e-aed9-6af4a3767afd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:56.966787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4d7ba7b9-3b99-419e-aed9-6af4a3767afd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:56.973415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4d7ba7b9-3b99-419e-aed9-6af4a3767afd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:56.973870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4d7ba7b9-3b99-419e-aed9-6af4a3767afd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:56.974665 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4d7ba7b9-3b99-419e-aed9-6af4a3767afd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:56.975106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4d7ba7b9-3b99-419e-aed9-6af4a3767afd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:57.004269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4d7ba7b9-3b99-419e-aed9-6af4a3767afd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 Jun 02 16:23:57.004816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 739/1431] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:23:57.978552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eff1e504-61e4-4d45-9a62-b0cc134fc067 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:57.979204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eff1e504-61e4-4d45-9a62-b0cc134fc067 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:57.985518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eff1e504-61e4-4d45-9a62-b0cc134fc067 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:57.985970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eff1e504-61e4-4d45-9a62-b0cc134fc067 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:57.986760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eff1e504-61e4-4d45-9a62-b0cc134fc067 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:57.987198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eff1e504-61e4-4d45-9a62-b0cc134fc067 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:58.053065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-eff1e504-61e4-4d45-9a62-b0cc134fc067 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:58.060545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eff1e504-61e4-4d45-9a62-b0cc134fc067 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085857 Jun 02 16:23:58.061100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 740/1432] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:57 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:58.066393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c3297903-3477-4121-b7ce-685e03399ad2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:58.067319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c3297903-3477-4121-b7ce-685e03399ad2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:58.072939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3297903-3477-4121-b7ce-685e03399ad2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:58.073509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3297903-3477-4121-b7ce-685e03399ad2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:58.074305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3297903-3477-4121-b7ce-685e03399ad2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:58.074745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3297903-3477-4121-b7ce-685e03399ad2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:58.103574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c3297903-3477-4121-b7ce-685e03399ad2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041518 Jun 02 16:23:58.104119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 741/1433] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:58 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:23:59.078526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-55729395-89a9-408e-8050-77b1f5952154 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:59.079175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-55729395-89a9-408e-8050-77b1f5952154 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:59.086433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55729395-89a9-408e-8050-77b1f5952154 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:59.086898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55729395-89a9-408e-8050-77b1f5952154 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:59.087691 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55729395-89a9-408e-8050-77b1f5952154 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:59.088136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-55729395-89a9-408e-8050-77b1f5952154 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:59.151998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-55729395-89a9-408e-8050-77b1f5952154 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:23:59.159393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-55729395-89a9-408e-8050-77b1f5952154 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084719 Jun 02 16:23:59.159955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 742/1434] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:23:59 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:23:59.164322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b44b50f7-e4ed-48f3-99cb-4c58ca2a3b7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:23:59.165223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b44b50f7-e4ed-48f3-99cb-4c58ca2a3b7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:23:59.170834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b44b50f7-e4ed-48f3-99cb-4c58ca2a3b7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:59.171278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b44b50f7-e4ed-48f3-99cb-4c58ca2a3b7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:59.172033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b44b50f7-e4ed-48f3-99cb-4c58ca2a3b7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:23:59.172506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b44b50f7-e4ed-48f3-99cb-4c58ca2a3b7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:23:59.201961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b44b50f7-e4ed-48f3-99cb-4c58ca2a3b7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041000 Jun 02 16:23:59.202549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 743/1435] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:23:59 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:00.176718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b4bb8ff3-a682-45c0-928a-e49938f2eb04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:00.177369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b4bb8ff3-a682-45c0-928a-e49938f2eb04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:00.183810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ff3-a682-45c0-928a-e49938f2eb04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:00.184270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ff3-a682-45c0-928a-e49938f2eb04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:00.185038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ff3-a682-45c0-928a-e49938f2eb04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:00.185503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ff3-a682-45c0-928a-e49938f2eb04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:00.249926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b4bb8ff3-a682-45c0-928a-e49938f2eb04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:00.257940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b4bb8ff3-a682-45c0-928a-e49938f2eb04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085625 Jun 02 16:24:00.258541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 744/1436] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:00 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:00.262966 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d100464b-690a-4127-b226-6a35d43a4c2b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:00.263870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d100464b-690a-4127-b226-6a35d43a4c2b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:00.269985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d100464b-690a-4127-b226-6a35d43a4c2b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:00.270467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d100464b-690a-4127-b226-6a35d43a4c2b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:00.271234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d100464b-690a-4127-b226-6a35d43a4c2b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:00.271674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d100464b-690a-4127-b226-6a35d43a4c2b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:00.300276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d100464b-690a-4127-b226-6a35d43a4c2b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040634 Jun 02 16:24:00.300820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 745/1437] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:01.275339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0ca09e85-e60a-4781-9bb7-84cc69a4b1a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:01.276030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0ca09e85-e60a-4781-9bb7-84cc69a4b1a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:01.282444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ca09e85-e60a-4781-9bb7-84cc69a4b1a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:01.282894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ca09e85-e60a-4781-9bb7-84cc69a4b1a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:01.283654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ca09e85-e60a-4781-9bb7-84cc69a4b1a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:01.284112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ca09e85-e60a-4781-9bb7-84cc69a4b1a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:01.344738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0ca09e85-e60a-4781-9bb7-84cc69a4b1a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:01.352666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0ca09e85-e60a-4781-9bb7-84cc69a4b1a7 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081212 Jun 02 16:24:01.353226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 746/1438] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:01 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:01.357649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-98e24ba2-7e93-4d07-bec7-c3a95ee1d24d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:01.358570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-98e24ba2-7e93-4d07-bec7-c3a95ee1d24d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:01.364163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-98e24ba2-7e93-4d07-bec7-c3a95ee1d24d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:01.364610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-98e24ba2-7e93-4d07-bec7-c3a95ee1d24d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:01.365364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-98e24ba2-7e93-4d07-bec7-c3a95ee1d24d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:01.365797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-98e24ba2-7e93-4d07-bec7-c3a95ee1d24d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:01.394767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-98e24ba2-7e93-4d07-bec7-c3a95ee1d24d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040558 Jun 02 16:24:01.395306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 747/1439] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:01 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:02.369566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5cb96f12-8eaa-4428-b8ad-7f851fa82bf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:02.370271 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5cb96f12-8eaa-4428-b8ad-7f851fa82bf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:02.376801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cb96f12-8eaa-4428-b8ad-7f851fa82bf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:02.377240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cb96f12-8eaa-4428-b8ad-7f851fa82bf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:02.378616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cb96f12-8eaa-4428-b8ad-7f851fa82bf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:02.379050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5cb96f12-8eaa-4428-b8ad-7f851fa82bf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:02.447919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5cb96f12-8eaa-4428-b8ad-7f851fa82bf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:02.456887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5cb96f12-8eaa-4428-b8ad-7f851fa82bf8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.090601 Jun 02 16:24:02.457475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 748/1440] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:02 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:02.462622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-928b1787-0854-4887-a9df-572677a085c6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:02.463541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-928b1787-0854-4887-a9df-572677a085c6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:02.471575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-928b1787-0854-4887-a9df-572677a085c6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:02.472608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-928b1787-0854-4887-a9df-572677a085c6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:02.473895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-928b1787-0854-4887-a9df-572677a085c6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:02.474373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-928b1787-0854-4887-a9df-572677a085c6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:02.511238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-928b1787-0854-4887-a9df-572677a085c6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052738 Jun 02 16:24:02.511785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 749/1441] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:03.534293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bb440d76-3a5a-4787-812a-f2a5ae8fd1b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:03.534293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bb440d76-3a5a-4787-812a-f2a5ae8fd1b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:03.534293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb440d76-3a5a-4787-812a-f2a5ae8fd1b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:03.534293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb440d76-3a5a-4787-812a-f2a5ae8fd1b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:03.535326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb440d76-3a5a-4787-812a-f2a5ae8fd1b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:03.535326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb440d76-3a5a-4787-812a-f2a5ae8fd1b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:03.549111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bb440d76-3a5a-4787-812a-f2a5ae8fd1b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:03.557234 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bb440d76-3a5a-4787-812a-f2a5ae8fd1b8 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086172 Jun 02 16:24:03.557844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 750/1442] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:03 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:03.562314 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ca78c26b-4889-4571-ba2b-2ce20028c932 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:03.563271 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ca78c26b-4889-4571-ba2b-2ce20028c932 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:03.570066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca78c26b-4889-4571-ba2b-2ce20028c932 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:03.570546 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca78c26b-4889-4571-ba2b-2ce20028c932 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:03.571305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca78c26b-4889-4571-ba2b-2ce20028c932 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:03.571742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca78c26b-4889-4571-ba2b-2ce20028c932 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:03.601575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ca78c26b-4889-4571-ba2b-2ce20028c932 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042703 Jun 02 16:24:03.602180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 751/1443] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:03 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:04.574924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-257643c5-e4b3-42c6-b49a-ffe461dc0693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:04.575557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-257643c5-e4b3-42c6-b49a-ffe461dc0693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:04.582617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257643c5-e4b3-42c6-b49a-ffe461dc0693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:04.583071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257643c5-e4b3-42c6-b49a-ffe461dc0693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:04.583838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257643c5-e4b3-42c6-b49a-ffe461dc0693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:04.584275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257643c5-e4b3-42c6-b49a-ffe461dc0693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:04.645770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-257643c5-e4b3-42c6-b49a-ffe461dc0693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:04.653147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-257643c5-e4b3-42c6-b49a-ffe461dc0693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082196 Jun 02 16:24:04.653725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 752/1444] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:04 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:04.658305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-34329b18-6fe9-4f1e-99ad-79bed6054b0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:04.659223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-34329b18-6fe9-4f1e-99ad-79bed6054b0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:04.666085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34329b18-6fe9-4f1e-99ad-79bed6054b0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:04.666552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34329b18-6fe9-4f1e-99ad-79bed6054b0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:04.667319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34329b18-6fe9-4f1e-99ad-79bed6054b0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:04.667779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34329b18-6fe9-4f1e-99ad-79bed6054b0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:04.671342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:24:04.695740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-34329b18-6fe9-4f1e-99ad-79bed6054b0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041012 Jun 02 16:24:04.696294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 753/1445] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:04 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:05.670756 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-662b5fdf-0031-4364-accc-1b4efcaac1ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:05.671427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-662b5fdf-0031-4364-accc-1b4efcaac1ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:05.678770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-662b5fdf-0031-4364-accc-1b4efcaac1ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:05.687824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-662b5fdf-0031-4364-accc-1b4efcaac1ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:05.687824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-662b5fdf-0031-4364-accc-1b4efcaac1ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:05.687824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-662b5fdf-0031-4364-accc-1b4efcaac1ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:05.741986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-662b5fdf-0031-4364-accc-1b4efcaac1ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:05.749600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-662b5fdf-0031-4364-accc-1b4efcaac1ea tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082647 Jun 02 16:24:05.750170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 754/1446] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:05.754841 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-928c74fd-b644-4966-aba0-7c1e6a840ff5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:05.755796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-928c74fd-b644-4966-aba0-7c1e6a840ff5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:05.761375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-928c74fd-b644-4966-aba0-7c1e6a840ff5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:05.761819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-928c74fd-b644-4966-aba0-7c1e6a840ff5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:05.762662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-928c74fd-b644-4966-aba0-7c1e6a840ff5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:05.763104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-928c74fd-b644-4966-aba0-7c1e6a840ff5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:05.792545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-928c74fd-b644-4966-aba0-7c1e6a840ff5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041377 Jun 02 16:24:05.793093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 755/1447] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:06.767199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-937d17d6-fbcd-471d-a782-63955da7f66e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:06.767828 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-937d17d6-fbcd-471d-a782-63955da7f66e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:06.775022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-937d17d6-fbcd-471d-a782-63955da7f66e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:06.775465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-937d17d6-fbcd-471d-a782-63955da7f66e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:06.776217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-937d17d6-fbcd-471d-a782-63955da7f66e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:06.776647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-937d17d6-fbcd-471d-a782-63955da7f66e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:06.840315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-937d17d6-fbcd-471d-a782-63955da7f66e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:06.848093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-937d17d6-fbcd-471d-a782-63955da7f66e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084679 Jun 02 16:24:06.848646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 756/1448] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:06 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:06.853067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5e3af998-9674-4516-b904-bfb2ebf9f60c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:06.853953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5e3af998-9674-4516-b904-bfb2ebf9f60c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:06.859474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e3af998-9674-4516-b904-bfb2ebf9f60c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:06.859913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e3af998-9674-4516-b904-bfb2ebf9f60c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:06.860661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e3af998-9674-4516-b904-bfb2ebf9f60c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:06.861091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e3af998-9674-4516-b904-bfb2ebf9f60c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:06.890902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5e3af998-9674-4516-b904-bfb2ebf9f60c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 Jun 02 16:24:06.891440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 757/1449] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:07.864954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ee06f425-489d-41c0-af24-36966b1bd1c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:07.865698 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ee06f425-489d-41c0-af24-36966b1bd1c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:07.871891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee06f425-489d-41c0-af24-36966b1bd1c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:07.872333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee06f425-489d-41c0-af24-36966b1bd1c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:07.873074 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee06f425-489d-41c0-af24-36966b1bd1c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:07.873504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee06f425-489d-41c0-af24-36966b1bd1c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:07.933611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ee06f425-489d-41c0-af24-36966b1bd1c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:07.940918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ee06f425-489d-41c0-af24-36966b1bd1c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079921 Jun 02 16:24:07.941464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 758/1450] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:07 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:07.946690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-570d7f8b-c3c6-472b-af50-fccb6fe728ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:07.947584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-570d7f8b-c3c6-472b-af50-fccb6fe728ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:07.953047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-570d7f8b-c3c6-472b-af50-fccb6fe728ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:07.953488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-570d7f8b-c3c6-472b-af50-fccb6fe728ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:07.954297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-570d7f8b-c3c6-472b-af50-fccb6fe728ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:07.954731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-570d7f8b-c3c6-472b-af50-fccb6fe728ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:07.983969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-570d7f8b-c3c6-472b-af50-fccb6fe728ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041515 Jun 02 16:24:07.984509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 759/1451] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:08.958595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9221a433-6106-4387-9535-d5b1b7cb7707 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:08.959240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9221a433-6106-4387-9535-d5b1b7cb7707 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:08.965628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9221a433-6106-4387-9535-d5b1b7cb7707 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:08.966103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9221a433-6106-4387-9535-d5b1b7cb7707 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:08.966861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9221a433-6106-4387-9535-d5b1b7cb7707 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:08.967295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9221a433-6106-4387-9535-d5b1b7cb7707 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:09.029401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9221a433-6106-4387-9535-d5b1b7cb7707 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:09.037600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9221a433-6106-4387-9535-d5b1b7cb7707 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082969 Jun 02 16:24:09.038182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 760/1452] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:08 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:09.042674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3d63f4b4-8b70-4c6f-8d41-2298463b0c29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:09.043572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3d63f4b4-8b70-4c6f-8d41-2298463b0c29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:09.049192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d63f4b4-8b70-4c6f-8d41-2298463b0c29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:09.049638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d63f4b4-8b70-4c6f-8d41-2298463b0c29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:09.050427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d63f4b4-8b70-4c6f-8d41-2298463b0c29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:09.050861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d63f4b4-8b70-4c6f-8d41-2298463b0c29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:09.079058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3d63f4b4-8b70-4c6f-8d41-2298463b0c29 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039902 Jun 02 16:24:09.079601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 761/1453] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:10.054969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-86867b71-cab7-4184-b34c-0a69cfd338bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:10.055679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-86867b71-cab7-4184-b34c-0a69cfd338bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:10.061795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86867b71-cab7-4184-b34c-0a69cfd338bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:10.062282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86867b71-cab7-4184-b34c-0a69cfd338bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:10.063052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86867b71-cab7-4184-b34c-0a69cfd338bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:10.063489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86867b71-cab7-4184-b34c-0a69cfd338bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:10.123051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-86867b71-cab7-4184-b34c-0a69cfd338bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:10.131479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-86867b71-cab7-4184-b34c-0a69cfd338bd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080773 Jun 02 16:24:10.132061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 762/1454] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:10.136774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e6465e6e-a757-4678-9319-95f37ddd5d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:10.139218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e6465e6e-a757-4678-9319-95f37ddd5d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:10.143569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6465e6e-a757-4678-9319-95f37ddd5d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:10.144021 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6465e6e-a757-4678-9319-95f37ddd5d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:10.144784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6465e6e-a757-4678-9319-95f37ddd5d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:10.145872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e6465e6e-a757-4678-9319-95f37ddd5d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:10.174893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e6465e6e-a757-4678-9319-95f37ddd5d95 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041729 Jun 02 16:24:10.179324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 763/1455] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:10 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:11.148563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ef3fc3c1-a3ec-4173-9d6d-7e3385c7719e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:11.149217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ef3fc3c1-a3ec-4173-9d6d-7e3385c7719e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:11.155666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef3fc3c1-a3ec-4173-9d6d-7e3385c7719e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:11.156107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef3fc3c1-a3ec-4173-9d6d-7e3385c7719e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:11.156865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef3fc3c1-a3ec-4173-9d6d-7e3385c7719e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:11.157305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef3fc3c1-a3ec-4173-9d6d-7e3385c7719e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:11.222337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ef3fc3c1-a3ec-4173-9d6d-7e3385c7719e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:11.231076 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ef3fc3c1-a3ec-4173-9d6d-7e3385c7719e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086447 Jun 02 16:24:11.231644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 764/1456] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:11.236067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-70f6c901-4a88-424d-9f63-f898ee15b522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:11.237007 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-70f6c901-4a88-424d-9f63-f898ee15b522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:11.243729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70f6c901-4a88-424d-9f63-f898ee15b522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:11.244178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70f6c901-4a88-424d-9f63-f898ee15b522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:11.244941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70f6c901-4a88-424d-9f63-f898ee15b522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:11.245378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70f6c901-4a88-424d-9f63-f898ee15b522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:11.275001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-70f6c901-4a88-424d-9f63-f898ee15b522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042382 Jun 02 16:24:11.275561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 765/1457] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:11 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:12.248503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dc207bc3-bade-41f2-b8f7-549f3745186d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:12.249147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dc207bc3-bade-41f2-b8f7-549f3745186d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:12.256344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc207bc3-bade-41f2-b8f7-549f3745186d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:12.256794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc207bc3-bade-41f2-b8f7-549f3745186d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:12.257554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc207bc3-bade-41f2-b8f7-549f3745186d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:12.257988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc207bc3-bade-41f2-b8f7-549f3745186d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:12.320881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-dc207bc3-bade-41f2-b8f7-549f3745186d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:12.328310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dc207bc3-bade-41f2-b8f7-549f3745186d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083663 Jun 02 16:24:12.328873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 766/1458] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:12.333376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7c00ebcd-f178-44b4-9fba-bb936ee20885 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:12.334299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7c00ebcd-f178-44b4-9fba-bb936ee20885 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:12.339862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c00ebcd-f178-44b4-9fba-bb936ee20885 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:12.340310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c00ebcd-f178-44b4-9fba-bb936ee20885 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:12.341066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c00ebcd-f178-44b4-9fba-bb936ee20885 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:12.341499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7c00ebcd-f178-44b4-9fba-bb936ee20885 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:12.371473 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7c00ebcd-f178-44b4-9fba-bb936ee20885 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041628 Jun 02 16:24:12.372013 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 767/1459] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:13.345689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-30098021-1c3a-470f-8ab5-87c910800a97 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:13.346358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-30098021-1c3a-470f-8ab5-87c910800a97 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:13.352860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30098021-1c3a-470f-8ab5-87c910800a97 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:13.353307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30098021-1c3a-470f-8ab5-87c910800a97 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:13.354061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30098021-1c3a-470f-8ab5-87c910800a97 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:13.354515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30098021-1c3a-470f-8ab5-87c910800a97 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:13.415060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-30098021-1c3a-470f-8ab5-87c910800a97 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:13.422399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-30098021-1c3a-470f-8ab5-87c910800a97 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080834 Jun 02 16:24:13.423036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 768/1460] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:13 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:13.427539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f3dfaab4-5fb2-4f2e-b1f7-7a6bde3410bd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:13.428435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f3dfaab4-5fb2-4f2e-b1f7-7a6bde3410bd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:13.433963 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3dfaab4-5fb2-4f2e-b1f7-7a6bde3410bd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:13.434431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3dfaab4-5fb2-4f2e-b1f7-7a6bde3410bd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:13.435180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3dfaab4-5fb2-4f2e-b1f7-7a6bde3410bd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:13.435605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3dfaab4-5fb2-4f2e-b1f7-7a6bde3410bd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:13.460300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:24:13.464557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f3dfaab4-5fb2-4f2e-b1f7-7a6bde3410bd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040669 Jun 02 16:24:13.465100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 769/1461] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:13 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:14.439713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-15b977e7-2525-4505-9b69-4148292b7cd3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:14.440361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-15b977e7-2525-4505-9b69-4148292b7cd3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:14.447566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15b977e7-2525-4505-9b69-4148292b7cd3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:14.448028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15b977e7-2525-4505-9b69-4148292b7cd3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:14.448792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15b977e7-2525-4505-9b69-4148292b7cd3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:14.449230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15b977e7-2525-4505-9b69-4148292b7cd3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:14.509333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-15b977e7-2525-4505-9b69-4148292b7cd3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:14.516857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-15b977e7-2525-4505-9b69-4148292b7cd3 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081125 Jun 02 16:24:14.517417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 770/1462] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:14.526166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d047fcae-7f6a-4922-8051-58269dfa7cb4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:14.526166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d047fcae-7f6a-4922-8051-58269dfa7cb4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:14.529381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d047fcae-7f6a-4922-8051-58269dfa7cb4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:14.529826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d047fcae-7f6a-4922-8051-58269dfa7cb4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:14.530620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d047fcae-7f6a-4922-8051-58269dfa7cb4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:14.531088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d047fcae-7f6a-4922-8051-58269dfa7cb4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:14.560170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d047fcae-7f6a-4922-8051-58269dfa7cb4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Jun 02 16:24:14.560708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 771/1463] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:15.534302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9eba37c7-1fe7-422f-981a-1c319e16f308 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:15.534945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9eba37c7-1fe7-422f-981a-1c319e16f308 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:15.541913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9eba37c7-1fe7-422f-981a-1c319e16f308 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:15.542384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9eba37c7-1fe7-422f-981a-1c319e16f308 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:15.543135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9eba37c7-1fe7-422f-981a-1c319e16f308 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:15.543563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9eba37c7-1fe7-422f-981a-1c319e16f308 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:15.609016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9eba37c7-1fe7-422f-981a-1c319e16f308 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:15.617161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9eba37c7-1fe7-422f-981a-1c319e16f308 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086770 Jun 02 16:24:15.617715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 772/1464] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:15.622168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-038ac0bb-ad39-4b95-af42-6c01cbae1319 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:15.623065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-038ac0bb-ad39-4b95-af42-6c01cbae1319 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:15.628560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-038ac0bb-ad39-4b95-af42-6c01cbae1319 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:15.629010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-038ac0bb-ad39-4b95-af42-6c01cbae1319 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:15.629803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-038ac0bb-ad39-4b95-af42-6c01cbae1319 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:15.630264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-038ac0bb-ad39-4b95-af42-6c01cbae1319 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:15.657542 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-038ac0bb-ad39-4b95-af42-6c01cbae1319 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038849 Jun 02 16:24:15.658105 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 773/1465] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:15 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:16.634936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-31084469-c1e5-4421-8063-55e7ee129ad9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:16.635571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-31084469-c1e5-4421-8063-55e7ee129ad9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:16.641909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31084469-c1e5-4421-8063-55e7ee129ad9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:16.642390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31084469-c1e5-4421-8063-55e7ee129ad9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:16.643241 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31084469-c1e5-4421-8063-55e7ee129ad9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:16.643686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31084469-c1e5-4421-8063-55e7ee129ad9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:16.705598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-31084469-c1e5-4421-8063-55e7ee129ad9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:16.713136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-31084469-c1e5-4421-8063-55e7ee129ad9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082096 Jun 02 16:24:16.713704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 774/1466] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:16 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:16.718312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-89195557-a5eb-4353-84bb-860e905aa6a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:16.719213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-89195557-a5eb-4353-84bb-860e905aa6a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:16.725040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89195557-a5eb-4353-84bb-860e905aa6a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:16.725490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89195557-a5eb-4353-84bb-860e905aa6a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:16.726275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89195557-a5eb-4353-84bb-860e905aa6a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:16.726717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89195557-a5eb-4353-84bb-860e905aa6a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:16.756903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-89195557-a5eb-4353-84bb-860e905aa6a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042200 Jun 02 16:24:16.757443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 775/1467] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:17.730126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-325bd725-1ef3-4a7b-8492-cdbb204fe695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:17.730820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-325bd725-1ef3-4a7b-8492-cdbb204fe695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:17.739195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-325bd725-1ef3-4a7b-8492-cdbb204fe695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:17.739651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-325bd725-1ef3-4a7b-8492-cdbb204fe695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:17.740420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-325bd725-1ef3-4a7b-8492-cdbb204fe695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:17.740861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-325bd725-1ef3-4a7b-8492-cdbb204fe695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:17.802323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-325bd725-1ef3-4a7b-8492-cdbb204fe695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:17.809687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-325bd725-1ef3-4a7b-8492-cdbb204fe695 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083405 Jun 02 16:24:17.810286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 776/1468] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:17 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:17.814708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3e01c568-c582-4794-b213-a7bc1b0d003a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:17.815610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3e01c568-c582-4794-b213-a7bc1b0d003a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:17.822398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e01c568-c582-4794-b213-a7bc1b0d003a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:17.822851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e01c568-c582-4794-b213-a7bc1b0d003a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:17.823616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e01c568-c582-4794-b213-a7bc1b0d003a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:17.824056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3e01c568-c582-4794-b213-a7bc1b0d003a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:17.853691 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3e01c568-c582-4794-b213-a7bc1b0d003a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Jun 02 16:24:17.854263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 777/1469] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:18.827025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8ddaf3a3-56a3-4e48-bc8f-4bdf0780560d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:18.827686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8ddaf3a3-56a3-4e48-bc8f-4bdf0780560d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:18.835211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddaf3a3-56a3-4e48-bc8f-4bdf0780560d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:18.835661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddaf3a3-56a3-4e48-bc8f-4bdf0780560d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:18.836419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddaf3a3-56a3-4e48-bc8f-4bdf0780560d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:18.836857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddaf3a3-56a3-4e48-bc8f-4bdf0780560d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:18.898914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8ddaf3a3-56a3-4e48-bc8f-4bdf0780560d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:18.906371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8ddaf3a3-56a3-4e48-bc8f-4bdf0780560d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083182 Jun 02 16:24:18.906865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 778/1470] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:18 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:18.911928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-85274e9d-be43-425e-a196-619ced3b1f8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:18.912821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-85274e9d-be43-425e-a196-619ced3b1f8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:18.918299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85274e9d-be43-425e-a196-619ced3b1f8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:18.918740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85274e9d-be43-425e-a196-619ced3b1f8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:18.919487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85274e9d-be43-425e-a196-619ced3b1f8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:18.919914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85274e9d-be43-425e-a196-619ced3b1f8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:18.947757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-85274e9d-be43-425e-a196-619ced3b1f8c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039942 Jun 02 16:24:18.948293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 779/1471] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:19.924383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a17b8400-2a15-4284-be27-2f5deca447c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:19.925054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a17b8400-2a15-4284-be27-2f5deca447c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:19.931636 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a17b8400-2a15-4284-be27-2f5deca447c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:19.932079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a17b8400-2a15-4284-be27-2f5deca447c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:19.932824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a17b8400-2a15-4284-be27-2f5deca447c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:19.933253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a17b8400-2a15-4284-be27-2f5deca447c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:19.996495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a17b8400-2a15-4284-be27-2f5deca447c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:20.004571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a17b8400-2a15-4284-be27-2f5deca447c0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083480 Jun 02 16:24:20.005189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 780/1472] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:20.009650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-85c5e339-9599-4127-ba06-ba00110be9f8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:20.010573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-85c5e339-9599-4127-ba06-ba00110be9f8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:20.016095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85c5e339-9599-4127-ba06-ba00110be9f8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:20.016541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85c5e339-9599-4127-ba06-ba00110be9f8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:20.017295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85c5e339-9599-4127-ba06-ba00110be9f8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:20.017730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-85c5e339-9599-4127-ba06-ba00110be9f8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:20.045673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-85c5e339-9599-4127-ba06-ba00110be9f8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039577 Jun 02 16:24:20.046232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 781/1473] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:21.021229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-221ae82d-2558-4fba-abf0-379559a94b04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:21.021896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-221ae82d-2558-4fba-abf0-379559a94b04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:21.028455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-221ae82d-2558-4fba-abf0-379559a94b04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:21.028898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-221ae82d-2558-4fba-abf0-379559a94b04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:21.029653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-221ae82d-2558-4fba-abf0-379559a94b04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:21.030100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-221ae82d-2558-4fba-abf0-379559a94b04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:21.090510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-221ae82d-2558-4fba-abf0-379559a94b04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:21.099173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-221ae82d-2558-4fba-abf0-379559a94b04 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082069 Jun 02 16:24:21.099736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 782/1474] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:21.104221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4f404072-f6e4-4537-ae18-dc4da924d772 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:21.105128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4f404072-f6e4-4537-ae18-dc4da924d772 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:21.110877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4f404072-f6e4-4537-ae18-dc4da924d772 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:21.111327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4f404072-f6e4-4537-ae18-dc4da924d772 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:21.112097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4f404072-f6e4-4537-ae18-dc4da924d772 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:21.112536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4f404072-f6e4-4537-ae18-dc4da924d772 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:21.142679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4f404072-f6e4-4537-ae18-dc4da924d772 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041983 Jun 02 16:24:21.143222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 783/1475] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:22.116761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-100e1956-367e-4d97-908c-fe6b4586a12f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:22.117443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-100e1956-367e-4d97-908c-fe6b4586a12f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:22.123767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-100e1956-367e-4d97-908c-fe6b4586a12f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:22.124209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-100e1956-367e-4d97-908c-fe6b4586a12f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:22.124961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-100e1956-367e-4d97-908c-fe6b4586a12f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:22.125390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-100e1956-367e-4d97-908c-fe6b4586a12f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:22.186100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-100e1956-367e-4d97-908c-fe6b4586a12f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:22.193768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-100e1956-367e-4d97-908c-fe6b4586a12f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081512 Jun 02 16:24:22.194439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 784/1476] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:22.198892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5e51d2fa-e6b1-478c-a4bb-4ae5434159c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:22.199787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5e51d2fa-e6b1-478c-a4bb-4ae5434159c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:22.205300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e51d2fa-e6b1-478c-a4bb-4ae5434159c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:22.205740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e51d2fa-e6b1-478c-a4bb-4ae5434159c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:22.206530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e51d2fa-e6b1-478c-a4bb-4ae5434159c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:22.206962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e51d2fa-e6b1-478c-a4bb-4ae5434159c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:22.235941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5e51d2fa-e6b1-478c-a4bb-4ae5434159c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040523 Jun 02 16:24:22.236481 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 785/1477] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:23.211375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fe32bc37-eef9-4a72-9e65-98fed21f92b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:23.211995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fe32bc37-eef9-4a72-9e65-98fed21f92b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:23.218513 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe32bc37-eef9-4a72-9e65-98fed21f92b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:23.218949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe32bc37-eef9-4a72-9e65-98fed21f92b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:23.219710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe32bc37-eef9-4a72-9e65-98fed21f92b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:23.220398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe32bc37-eef9-4a72-9e65-98fed21f92b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:23.234763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:24:23.281864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fe32bc37-eef9-4a72-9e65-98fed21f92b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:23.289492 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fe32bc37-eef9-4a72-9e65-98fed21f92b6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082530 Jun 02 16:24:23.290059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 786/1478] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:23 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:23.294556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3d20b787-9fd8-4e00-9529-9a70f9e984d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:23.295457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3d20b787-9fd8-4e00-9529-9a70f9e984d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:23.301679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d20b787-9fd8-4e00-9529-9a70f9e984d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:23.302397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d20b787-9fd8-4e00-9529-9a70f9e984d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:23.303205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d20b787-9fd8-4e00-9529-9a70f9e984d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:23.303635 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d20b787-9fd8-4e00-9529-9a70f9e984d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:23.332319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3d20b787-9fd8-4e00-9529-9a70f9e984d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041170 Jun 02 16:24:23.332869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 787/1479] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:24.305809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f32e295d-62f4-4332-adb4-1933ea0daf5d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:24.306477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f32e295d-62f4-4332-adb4-1933ea0daf5d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:24.308753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:24:24.313592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f32e295d-62f4-4332-adb4-1933ea0daf5d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:24.314038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f32e295d-62f4-4332-adb4-1933ea0daf5d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:24.314828 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f32e295d-62f4-4332-adb4-1933ea0daf5d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:24.315259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f32e295d-62f4-4332-adb4-1933ea0daf5d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:24.379753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f32e295d-62f4-4332-adb4-1933ea0daf5d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:24.387143 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f32e295d-62f4-4332-adb4-1933ea0daf5d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085201 Jun 02 16:24:24.387699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 788/1480] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:24 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:24.392246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-91ccc295-23c2-4cfe-8efe-e5971de9984e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:24.393168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-91ccc295-23c2-4cfe-8efe-e5971de9984e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:24.399418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-91ccc295-23c2-4cfe-8efe-e5971de9984e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:24.399862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-91ccc295-23c2-4cfe-8efe-e5971de9984e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:24.400614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-91ccc295-23c2-4cfe-8efe-e5971de9984e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:24.401038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-91ccc295-23c2-4cfe-8efe-e5971de9984e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:24.431146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-91ccc295-23c2-4cfe-8efe-e5971de9984e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042367 Jun 02 16:24:24.431630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 789/1481] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:25.404732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a5a7df4e-599a-4dc7-9d18-0a967c202713 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:25.405417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a5a7df4e-599a-4dc7-9d18-0a967c202713 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:25.412274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5a7df4e-599a-4dc7-9d18-0a967c202713 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:25.412720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5a7df4e-599a-4dc7-9d18-0a967c202713 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:25.413479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5a7df4e-599a-4dc7-9d18-0a967c202713 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:25.413911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5a7df4e-599a-4dc7-9d18-0a967c202713 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:25.475894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a5a7df4e-599a-4dc7-9d18-0a967c202713 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:25.483391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a5a7df4e-599a-4dc7-9d18-0a967c202713 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082523 Jun 02 16:24:25.483958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 790/1482] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:25 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:25.488810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-daac1e7b-d51f-4312-9b73-5f75c8b21bb1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:25.489866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-daac1e7b-d51f-4312-9b73-5f75c8b21bb1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:25.495609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-daac1e7b-d51f-4312-9b73-5f75c8b21bb1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:25.496058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-daac1e7b-d51f-4312-9b73-5f75c8b21bb1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:25.496816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-daac1e7b-d51f-4312-9b73-5f75c8b21bb1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:25.497257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-daac1e7b-d51f-4312-9b73-5f75c8b21bb1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:25.530836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-daac1e7b-d51f-4312-9b73-5f75c8b21bb1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045882 Jun 02 16:24:25.531384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 791/1483] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:25 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:26.500037 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-08ca4af2-485e-4337-90ab-69be03be6853 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:26.500690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-08ca4af2-485e-4337-90ab-69be03be6853 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:26.507132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08ca4af2-485e-4337-90ab-69be03be6853 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:26.507574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08ca4af2-485e-4337-90ab-69be03be6853 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:26.508330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08ca4af2-485e-4337-90ab-69be03be6853 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:26.508754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08ca4af2-485e-4337-90ab-69be03be6853 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:26.571821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-08ca4af2-485e-4337-90ab-69be03be6853 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:26.579318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-08ca4af2-485e-4337-90ab-69be03be6853 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083131 Jun 02 16:24:26.579909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 792/1484] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:26 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:26.585179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e2915ca7-c496-4bf8-ac45-e55047718381 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:26.586108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e2915ca7-c496-4bf8-ac45-e55047718381 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:26.591806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2915ca7-c496-4bf8-ac45-e55047718381 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:26.592256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2915ca7-c496-4bf8-ac45-e55047718381 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:26.593023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2915ca7-c496-4bf8-ac45-e55047718381 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:26.593464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2915ca7-c496-4bf8-ac45-e55047718381 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:26.623080 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e2915ca7-c496-4bf8-ac45-e55047718381 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042133 Jun 02 16:24:26.623631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 793/1485] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:27.597059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b124a090-d841-4c52-94f2-07a01f169010 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:27.598430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b124a090-d841-4c52-94f2-07a01f169010 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:27.604638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b124a090-d841-4c52-94f2-07a01f169010 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:27.605089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b124a090-d841-4c52-94f2-07a01f169010 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:27.605839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b124a090-d841-4c52-94f2-07a01f169010 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:27.606316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b124a090-d841-4c52-94f2-07a01f169010 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:27.667476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b124a090-d841-4c52-94f2-07a01f169010 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:27.674998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b124a090-d841-4c52-94f2-07a01f169010 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082127 Jun 02 16:24:27.675558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 794/1486] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:27 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:27.680731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-45bd3197-f86b-44a5-9d72-11c637a98856 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:27.681625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-45bd3197-f86b-44a5-9d72-11c637a98856 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:27.687249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-45bd3197-f86b-44a5-9d72-11c637a98856 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:27.687688 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-45bd3197-f86b-44a5-9d72-11c637a98856 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:27.688436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-45bd3197-f86b-44a5-9d72-11c637a98856 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:27.688862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-45bd3197-f86b-44a5-9d72-11c637a98856 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:27.716819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-45bd3197-f86b-44a5-9d72-11c637a98856 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040319 Jun 02 16:24:27.717352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 795/1487] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:28.692524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0a65782b-8b1a-45b8-a0ab-8c5bfb8b395b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:28.693933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0a65782b-8b1a-45b8-a0ab-8c5bfb8b395b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:28.700196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a65782b-8b1a-45b8-a0ab-8c5bfb8b395b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:28.701523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a65782b-8b1a-45b8-a0ab-8c5bfb8b395b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:28.701523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a65782b-8b1a-45b8-a0ab-8c5bfb8b395b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:28.701795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a65782b-8b1a-45b8-a0ab-8c5bfb8b395b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:28.765621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0a65782b-8b1a-45b8-a0ab-8c5bfb8b395b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:28.773167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0a65782b-8b1a-45b8-a0ab-8c5bfb8b395b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084493 Jun 02 16:24:28.773723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 796/1488] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:28 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:28.778214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-69d99005-a3f9-47f1-a96a-fa6c4591fc5d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:28.779108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-69d99005-a3f9-47f1-a96a-fa6c4591fc5d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:28.784581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-69d99005-a3f9-47f1-a96a-fa6c4591fc5d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:28.785027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-69d99005-a3f9-47f1-a96a-fa6c4591fc5d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:28.785776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-69d99005-a3f9-47f1-a96a-fa6c4591fc5d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:28.786244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-69d99005-a3f9-47f1-a96a-fa6c4591fc5d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:28.814403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-69d99005-a3f9-47f1-a96a-fa6c4591fc5d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039670 Jun 02 16:24:28.814946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 797/1489] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:29.790665 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-84ea5103-e89d-45cf-bdce-6f2c69158009 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:29.791299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-84ea5103-e89d-45cf-bdce-6f2c69158009 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:29.798317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84ea5103-e89d-45cf-bdce-6f2c69158009 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:29.798766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84ea5103-e89d-45cf-bdce-6f2c69158009 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:29.799528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84ea5103-e89d-45cf-bdce-6f2c69158009 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:29.799967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-84ea5103-e89d-45cf-bdce-6f2c69158009 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:29.862293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-84ea5103-e89d-45cf-bdce-6f2c69158009 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:29.870863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-84ea5103-e89d-45cf-bdce-6f2c69158009 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084780 Jun 02 16:24:29.871423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 798/1490] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:29 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:29.876032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b78b8618-21ee-450c-94da-6f304d9f26e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:29.876941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b78b8618-21ee-450c-94da-6f304d9f26e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:29.882956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b78b8618-21ee-450c-94da-6f304d9f26e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:29.883407 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b78b8618-21ee-450c-94da-6f304d9f26e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:29.884235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b78b8618-21ee-450c-94da-6f304d9f26e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:29.884670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b78b8618-21ee-450c-94da-6f304d9f26e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:29.914962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b78b8618-21ee-450c-94da-6f304d9f26e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Jun 02 16:24:29.915573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 799/1491] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:30.887374 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9ca7c7ff-aa83-416a-b6f3-ca7a16634158 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:30.888048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9ca7c7ff-aa83-416a-b6f3-ca7a16634158 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:30.894372 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ca7c7ff-aa83-416a-b6f3-ca7a16634158 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:30.894814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ca7c7ff-aa83-416a-b6f3-ca7a16634158 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:30.895563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ca7c7ff-aa83-416a-b6f3-ca7a16634158 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:30.896001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ca7c7ff-aa83-416a-b6f3-ca7a16634158 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:30.955808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9ca7c7ff-aa83-416a-b6f3-ca7a16634158 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:30.963470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9ca7c7ff-aa83-416a-b6f3-ca7a16634158 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079951 Jun 02 16:24:30.964022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 800/1492] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:30 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:30.968396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cafdcbf2-1232-4097-8046-640d531378dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:30.969293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cafdcbf2-1232-4097-8046-640d531378dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:30.975207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cafdcbf2-1232-4097-8046-640d531378dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:30.975644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cafdcbf2-1232-4097-8046-640d531378dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:30.976390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cafdcbf2-1232-4097-8046-640d531378dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:30.976818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cafdcbf2-1232-4097-8046-640d531378dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:31.007851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cafdcbf2-1232-4097-8046-640d531378dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Jun 02 16:24:31.008397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 801/1493] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:31.980458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-06bf135c-b1b5-4f25-a12e-67c01feb1e9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:31.981113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-06bf135c-b1b5-4f25-a12e-67c01feb1e9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:31.987479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06bf135c-b1b5-4f25-a12e-67c01feb1e9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:31.987929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06bf135c-b1b5-4f25-a12e-67c01feb1e9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:31.988688 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06bf135c-b1b5-4f25-a12e-67c01feb1e9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:31.989124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06bf135c-b1b5-4f25-a12e-67c01feb1e9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:32.049110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-06bf135c-b1b5-4f25-a12e-67c01feb1e9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:32.056668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-06bf135c-b1b5-4f25-a12e-67c01feb1e9c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080043 Jun 02 16:24:32.057228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 802/1494] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:31 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:32.061662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f1579cf2-a7d3-46e2-b545-1bf1f27f8df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:32.062586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f1579cf2-a7d3-46e2-b545-1bf1f27f8df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:32.068770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1579cf2-a7d3-46e2-b545-1bf1f27f8df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:32.069219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1579cf2-a7d3-46e2-b545-1bf1f27f8df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:32.069992 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1579cf2-a7d3-46e2-b545-1bf1f27f8df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:32.070440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1579cf2-a7d3-46e2-b545-1bf1f27f8df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:32.073935 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:24:32.098912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f1579cf2-a7d3-46e2-b545-1bf1f27f8df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040638 Jun 02 16:24:32.099458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 803/1495] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:33.073094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-190f7df4-7359-4a5e-a9c2-cb03e3bc323d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:33.073743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-190f7df4-7359-4a5e-a9c2-cb03e3bc323d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:33.080704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-190f7df4-7359-4a5e-a9c2-cb03e3bc323d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:33.081156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-190f7df4-7359-4a5e-a9c2-cb03e3bc323d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:33.081928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-190f7df4-7359-4a5e-a9c2-cb03e3bc323d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:33.082441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-190f7df4-7359-4a5e-a9c2-cb03e3bc323d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:33.146331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-190f7df4-7359-4a5e-a9c2-cb03e3bc323d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:33.153848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-190f7df4-7359-4a5e-a9c2-cb03e3bc323d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084642 Jun 02 16:24:33.154432 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 804/1496] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:33 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:33.158895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7653017c-a3c0-4d43-afb8-c677bb9f8d78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:33.159795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7653017c-a3c0-4d43-afb8-c677bb9f8d78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:33.167129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7653017c-a3c0-4d43-afb8-c677bb9f8d78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:33.167589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7653017c-a3c0-4d43-afb8-c677bb9f8d78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:33.168444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7653017c-a3c0-4d43-afb8-c677bb9f8d78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:33.168885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7653017c-a3c0-4d43-afb8-c677bb9f8d78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:33.200132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7653017c-a3c0-4d43-afb8-c677bb9f8d78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Jun 02 16:24:33.200645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 805/1497] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:34.171415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-055fab96-ac6c-4d33-91b2-3c2c7a22ea55 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:34.172080 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-055fab96-ac6c-4d33-91b2-3c2c7a22ea55 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:34.178722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-055fab96-ac6c-4d33-91b2-3c2c7a22ea55 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:34.179441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-055fab96-ac6c-4d33-91b2-3c2c7a22ea55 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:34.180203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-055fab96-ac6c-4d33-91b2-3c2c7a22ea55 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:34.180637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-055fab96-ac6c-4d33-91b2-3c2c7a22ea55 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:34.241901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-055fab96-ac6c-4d33-91b2-3c2c7a22ea55 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:34.249351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-055fab96-ac6c-4d33-91b2-3c2c7a22ea55 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081782 Jun 02 16:24:34.249915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 806/1498] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:34 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:34.254494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e1d6b577-3f14-4ed5-aa11-6b6e25b8f88d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:34.256109 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e1d6b577-3f14-4ed5-aa11-6b6e25b8f88d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:34.261724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1d6b577-3f14-4ed5-aa11-6b6e25b8f88d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:34.262212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1d6b577-3f14-4ed5-aa11-6b6e25b8f88d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:34.262977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1d6b577-3f14-4ed5-aa11-6b6e25b8f88d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:34.263411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1d6b577-3f14-4ed5-aa11-6b6e25b8f88d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:34.291695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e1d6b577-3f14-4ed5-aa11-6b6e25b8f88d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040781 Jun 02 16:24:34.292244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 807/1499] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:35.267576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ce3f965c-d234-458c-9f34-c80ef6f4ebd0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:35.268300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ce3f965c-d234-458c-9f34-c80ef6f4ebd0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:35.275140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce3f965c-d234-458c-9f34-c80ef6f4ebd0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:35.275588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce3f965c-d234-458c-9f34-c80ef6f4ebd0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:35.276336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce3f965c-d234-458c-9f34-c80ef6f4ebd0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:35.276765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce3f965c-d234-458c-9f34-c80ef6f4ebd0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:35.338154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ce3f965c-d234-458c-9f34-c80ef6f4ebd0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:35.345791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ce3f965c-d234-458c-9f34-c80ef6f4ebd0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082097 Jun 02 16:24:35.346446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 808/1500] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:35 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:35.351639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5ee279b2-7bbf-4eb8-b670-57b8e4b821ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:35.352544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5ee279b2-7bbf-4eb8-b670-57b8e4b821ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:35.358053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ee279b2-7bbf-4eb8-b670-57b8e4b821ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:35.358518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ee279b2-7bbf-4eb8-b670-57b8e4b821ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:35.359266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ee279b2-7bbf-4eb8-b670-57b8e4b821ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:35.359696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ee279b2-7bbf-4eb8-b670-57b8e4b821ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:35.553503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5ee279b2-7bbf-4eb8-b670-57b8e4b821ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205925 Jun 02 16:24:35.553941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 809/1501] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:35 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:36.362986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-923c0473-1744-4bb8-ad41-833a19b24964 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:36.363674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-923c0473-1744-4bb8-ad41-833a19b24964 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:36.370597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-923c0473-1744-4bb8-ad41-833a19b24964 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:36.371052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-923c0473-1744-4bb8-ad41-833a19b24964 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:36.371816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-923c0473-1744-4bb8-ad41-833a19b24964 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:36.372252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-923c0473-1744-4bb8-ad41-833a19b24964 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:36.431541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-923c0473-1744-4bb8-ad41-833a19b24964 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:36.438957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-923c0473-1744-4bb8-ad41-833a19b24964 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079859 Jun 02 16:24:36.439501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 810/1502] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:36 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:36.564349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eb67cd14-7c3f-42a2-8cb4-2faf5d742dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:36.565258 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eb67cd14-7c3f-42a2-8cb4-2faf5d742dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:36.571377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb67cd14-7c3f-42a2-8cb4-2faf5d742dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:36.571817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb67cd14-7c3f-42a2-8cb4-2faf5d742dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:36.572562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb67cd14-7c3f-42a2-8cb4-2faf5d742dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:36.572988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb67cd14-7c3f-42a2-8cb4-2faf5d742dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:36.601575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eb67cd14-7c3f-42a2-8cb4-2faf5d742dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041216 Jun 02 16:24:36.602126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 811/1503] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:36 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:24:37.455016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-06c57fb5-079f-4003-9da8-06263a6b8ac6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:37.455657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-06c57fb5-079f-4003-9da8-06263a6b8ac6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:37.462584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06c57fb5-079f-4003-9da8-06263a6b8ac6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:37.463024 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06c57fb5-079f-4003-9da8-06263a6b8ac6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:37.463774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06c57fb5-079f-4003-9da8-06263a6b8ac6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:37.464200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06c57fb5-079f-4003-9da8-06263a6b8ac6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:37.526369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-06c57fb5-079f-4003-9da8-06263a6b8ac6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:37.533739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-06c57fb5-079f-4003-9da8-06263a6b8ac6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082649 Jun 02 16:24:37.534311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 812/1504] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:37 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:24:37.612896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bb7a9b7f-06a5-4076-aa72-5c9e2a4c94e1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:37.613865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bb7a9b7f-06a5-4076-aa72-5c9e2a4c94e1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:37.619988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb7a9b7f-06a5-4076-aa72-5c9e2a4c94e1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:37.623298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb7a9b7f-06a5-4076-aa72-5c9e2a4c94e1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:37.623298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb7a9b7f-06a5-4076-aa72-5c9e2a4c94e1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:37.623298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb7a9b7f-06a5-4076-aa72-5c9e2a4c94e1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:37.650037 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bb7a9b7f-06a5-4076-aa72-5c9e2a4c94e1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041240 Jun 02 16:24:37.650601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 813/1505] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:37 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:24:38.550663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cded7d5e-1385-43e1-a8e2-f05a577b816f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:38.551297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cded7d5e-1385-43e1-a8e2-f05a577b816f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:38.558213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cded7d5e-1385-43e1-a8e2-f05a577b816f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:38.558666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cded7d5e-1385-43e1-a8e2-f05a577b816f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:38.559431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cded7d5e-1385-43e1-a8e2-f05a577b816f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:38.559868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cded7d5e-1385-43e1-a8e2-f05a577b816f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:38.621936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cded7d5e-1385-43e1-a8e2-f05a577b816f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:38.629353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cded7d5e-1385-43e1-a8e2-f05a577b816f tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082672 Jun 02 16:24:38.630146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 814/1506] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:38 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:38.661633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-aa1934ca-220e-4b54-9e08-b549b2bfae0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:38.662561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-aa1934ca-220e-4b54-9e08-b549b2bfae0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:38.668495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aa1934ca-220e-4b54-9e08-b549b2bfae0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:38.668947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aa1934ca-220e-4b54-9e08-b549b2bfae0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:38.669706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aa1934ca-220e-4b54-9e08-b549b2bfae0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:38.670178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aa1934ca-220e-4b54-9e08-b549b2bfae0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:38.698590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-aa1934ca-220e-4b54-9e08-b549b2bfae0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041165 Jun 02 16:24:38.699133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 815/1507] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:38 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:24:39.647140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-404dab6a-742b-4b51-a1c9-82d7b2346aef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:39.647766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-404dab6a-742b-4b51-a1c9-82d7b2346aef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:39.654097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-404dab6a-742b-4b51-a1c9-82d7b2346aef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:39.654557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-404dab6a-742b-4b51-a1c9-82d7b2346aef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:39.655322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-404dab6a-742b-4b51-a1c9-82d7b2346aef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:39.655761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-404dab6a-742b-4b51-a1c9-82d7b2346aef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:39.717128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-404dab6a-742b-4b51-a1c9-82d7b2346aef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:39.724885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-404dab6a-742b-4b51-a1c9-82d7b2346aef tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082332 Jun 02 16:24:39.725434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 816/1508] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:39 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:39.729896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b748ea7c-5d1b-4a94-8127-9405a987ca54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:39.730831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b748ea7c-5d1b-4a94-8127-9405a987ca54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:39.736341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b748ea7c-5d1b-4a94-8127-9405a987ca54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:39.736791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b748ea7c-5d1b-4a94-8127-9405a987ca54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:39.737587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b748ea7c-5d1b-4a94-8127-9405a987ca54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:39.738027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b748ea7c-5d1b-4a94-8127-9405a987ca54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:39.766601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b748ea7c-5d1b-4a94-8127-9405a987ca54 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040164 Jun 02 16:24:39.767327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 817/1509] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:40.742493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3d17694b-ff41-4252-a027-29cb21c23d72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:40.743170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3d17694b-ff41-4252-a027-29cb21c23d72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:40.750002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d17694b-ff41-4252-a027-29cb21c23d72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:40.750492 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d17694b-ff41-4252-a027-29cb21c23d72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:40.751279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d17694b-ff41-4252-a027-29cb21c23d72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:40.751717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3d17694b-ff41-4252-a027-29cb21c23d72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:40.818712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3d17694b-ff41-4252-a027-29cb21c23d72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:40.826393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3d17694b-ff41-4252-a027-29cb21c23d72 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.088382 Jun 02 16:24:40.826960 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 818/1510] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:40 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:40.831509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e8ac6b49-d649-4594-8ca2-ba6390ac0946 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:40.832419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e8ac6b49-d649-4594-8ca2-ba6390ac0946 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:40.838263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e8ac6b49-d649-4594-8ca2-ba6390ac0946 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:40.838715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e8ac6b49-d649-4594-8ca2-ba6390ac0946 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:40.839484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e8ac6b49-d649-4594-8ca2-ba6390ac0946 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:40.839922 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e8ac6b49-d649-4594-8ca2-ba6390ac0946 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:40.864904 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:24:40.869301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e8ac6b49-d649-4594-8ca2-ba6390ac0946 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041403 Jun 02 16:24:40.869843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 819/1511] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:24:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:24:41.844540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2b7b0d81-783d-4d1c-b482-95c00e537d6e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:41.845458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2b7b0d81-783d-4d1c-b482-95c00e537d6e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:41.853053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2b7b0d81-783d-4d1c-b482-95c00e537d6e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:41.853502 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2b7b0d81-783d-4d1c-b482-95c00e537d6e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:41.854284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2b7b0d81-783d-4d1c-b482-95c00e537d6e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:41.854718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2b7b0d81-783d-4d1c-b482-95c00e537d6e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:41.916980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2b7b0d81-783d-4d1c-b482-95c00e537d6e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:24:41.924546 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2b7b0d81-783d-4d1c-b482-95c00e537d6e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084014 Jun 02 16:24:41.925180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 820/1512] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:24:41 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:24:41.930811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:24:41.931323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:24:41.937085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:41.937540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:41.938350 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:24:41.938785 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:24:51.935097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=67 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:24:51.956157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=11 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:25:00.076515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:25:00.077111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:25:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 (ip 10.222.0.59) !!! Jun 02 16:25:06.155135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:25:06.155806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:25:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 (ip 10.222.0.59) !!! Jun 02 16:25:19.570900 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:25:19.571455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 (ip 10.222.0.59) !!! Jun 02 16:25:41.992664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c8494c4a-6ee0-487f-8f16-9b0852045dfb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91" status: 202 len: 0 microversion: 2.1 time: 120.188961 Jun 02 16:25:41.993325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 693/1513] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:23:41 2022] DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 => generated 0 bytes in 120190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:25:41.999395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-93a6d1b4-c31b-45f6-a29e-3078e74b358e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:42.000373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-93a6d1b4-c31b-45f6-a29e-3078e74b358e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:42.006756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93a6d1b4-c31b-45f6-a29e-3078e74b358e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:42.007212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93a6d1b4-c31b-45f6-a29e-3078e74b358e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:42.008276 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93a6d1b4-c31b-45f6-a29e-3078e74b358e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:42.008712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-93a6d1b4-c31b-45f6-a29e-3078e74b358e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:42.039700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-93a6d1b4-c31b-45f6-a29e-3078e74b358e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Jun 02 16:25:42.040264 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 694/1514] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:25:42.041217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lazy-loading 'services' on Instance uuid 6d9f21d8-cd12-4d8c-8dc7-765453991dcb {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:25:42.044882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a5b4eb48-e847-4c0c-8b79-40bfa2e66294 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:42.045522 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a5b4eb48-e847-4c0c-8b79-40bfa2e66294 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:42.051442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5b4eb48-e847-4c0c-8b79-40bfa2e66294 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:42.051892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5b4eb48-e847-4c0c-8b79-40bfa2e66294 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:42.052652 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5b4eb48-e847-4c0c-8b79-40bfa2e66294 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:42.053083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5b4eb48-e847-4c0c-8b79-40bfa2e66294 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:42.118048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a5b4eb48-e847-4c0c-8b79-40bfa2e66294 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:42.125833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a5b4eb48-e847-4c0c-8b79-40bfa2e66294 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084364 Jun 02 16:25:42.126428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 695/1515] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:42 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:25:42.130963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:42.131461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:42.137967 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:42.138463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:42.139229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:42.139701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:43.077871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fa18814-0b4d-46a7-91d2-c267b5d5e957) Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Request method failure captured: Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 HTTP/1.1 Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOIzXG0IbLAQ7CtI-2dW_2PANpK8dCZ603QjCOSjp_gxaJBvdTnGIjVojYhaNPazhUPy_6XKZgWaVz2lWWsAKUnhqYvjgkWOtQaI0_6YYma9gBniuhr7uWLDB7BooG4ngqcoc_QWeDddx7Bak-3uDdTtwK9JlQB9qDZQQMy6zP9E-68 Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:25:43.080167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}] Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 2910f2833ce24b17b248ad9106f19786 Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:25:43.082025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fa18814-0b4d-46a7-91d2-c267b5d5e957) Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'server_id': '6d9f21d8-cd12-4d8c-8dc7-765453991dcb', 'id': '82d67b29-e2bc-4537-86f3-ebba9d154c91'} Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 16:25:43.083211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fa18814-0b4d-46a7-91d2-c267b5d5e957) Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:25:43.085046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fa18814-0b4d-46a7-91d2-c267b5d5e957) Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:25:43.086429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fa18814-0b4d-46a7-91d2-c267b5d5e957) Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:25:43.087646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fa18814-0b4d-46a7-91d2-c267b5d5e957) Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fa18814-0b4d-46a7-91d2-c267b5d5e957) Jun 02 16:25:43.089320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:25:43.090811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fa18814-0b4d-46a7-91d2-c267b5d5e957) {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:25:43.090811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-296286d6-d239-45fe-9a60-c531c51d268d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91" status: 400 len: 269 microversion: 2.1 time: 61.155812 Jun 02 16:25:43.090811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 821/1516] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:24:41 2022] DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 => generated 269 bytes in 61157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:25:43.090811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-16bc5751-a690-4a36-9aa2-dcdb3bae38a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:43.091151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-16bc5751-a690-4a36-9aa2-dcdb3bae38a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:43.097212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16bc5751-a690-4a36-9aa2-dcdb3bae38a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:43.097655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16bc5751-a690-4a36-9aa2-dcdb3bae38a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:43.098448 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16bc5751-a690-4a36-9aa2-dcdb3bae38a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:43.098885 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16bc5751-a690-4a36-9aa2-dcdb3bae38a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:43.128201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-16bc5751-a690-4a36-9aa2-dcdb3bae38a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Jun 02 16:25:43.128951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 822/1517] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:43 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:25:43.151918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lazy-loading 'services' on Instance uuid 6d9f21d8-cd12-4d8c-8dc7-765453991dcb {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:25:43.152394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-454db30a-4e0b-4465-939a-39d6227d45bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:43.152394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-454db30a-4e0b-4465-939a-39d6227d45bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:43.152394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-454db30a-4e0b-4465-939a-39d6227d45bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:43.152394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-454db30a-4e0b-4465-939a-39d6227d45bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:43.152710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-454db30a-4e0b-4465-939a-39d6227d45bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:43.152710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-454db30a-4e0b-4465-939a-39d6227d45bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:43.212619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-454db30a-4e0b-4465-939a-39d6227d45bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:43.220286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-454db30a-4e0b-4465-939a-39d6227d45bb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081336 Jun 02 16:25:43.220834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 823/1518] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:43 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:44.139775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5b12b79a-6661-4cf6-88ab-d7295108c5eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:44.140690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5b12b79a-6661-4cf6-88ab-d7295108c5eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:44.147100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b12b79a-6661-4cf6-88ab-d7295108c5eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:44.148100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b12b79a-6661-4cf6-88ab-d7295108c5eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:44.148999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b12b79a-6661-4cf6-88ab-d7295108c5eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:44.149431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b12b79a-6661-4cf6-88ab-d7295108c5eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:44.177939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5b12b79a-6661-4cf6-88ab-d7295108c5eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042075 Jun 02 16:25:44.178503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 824/1519] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:44 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:44.237075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-945e535a-0647-4485-a29f-c84e788b02fb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:44.237671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-945e535a-0647-4485-a29f-c84e788b02fb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:44.243651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-945e535a-0647-4485-a29f-c84e788b02fb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:44.244077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-945e535a-0647-4485-a29f-c84e788b02fb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:44.244826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-945e535a-0647-4485-a29f-c84e788b02fb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:44.245256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-945e535a-0647-4485-a29f-c84e788b02fb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:44.305171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-945e535a-0647-4485-a29f-c84e788b02fb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:44.312618 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-945e535a-0647-4485-a29f-c84e788b02fb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079188 Jun 02 16:25:44.313175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 825/1520] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:44 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:45.188810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ee073628-a8f2-4dc1-99ad-6cd340d47c76 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:45.189736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ee073628-a8f2-4dc1-99ad-6cd340d47c76 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:45.196936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee073628-a8f2-4dc1-99ad-6cd340d47c76 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:45.197391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee073628-a8f2-4dc1-99ad-6cd340d47c76 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:45.202735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee073628-a8f2-4dc1-99ad-6cd340d47c76 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:45.202735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ee073628-a8f2-4dc1-99ad-6cd340d47c76 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:45.228194 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ee073628-a8f2-4dc1-99ad-6cd340d47c76 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Jun 02 16:25:45.229335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 826/1521] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:45.328553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-01fbafd6-e45d-45cf-a8aa-b1814cae3f5b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:45.329165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-01fbafd6-e45d-45cf-a8aa-b1814cae3f5b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:45.335736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01fbafd6-e45d-45cf-a8aa-b1814cae3f5b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:45.336192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01fbafd6-e45d-45cf-a8aa-b1814cae3f5b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:45.336952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01fbafd6-e45d-45cf-a8aa-b1814cae3f5b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:45.337404 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01fbafd6-e45d-45cf-a8aa-b1814cae3f5b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:45.398126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-01fbafd6-e45d-45cf-a8aa-b1814cae3f5b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:45.405409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-01fbafd6-e45d-45cf-a8aa-b1814cae3f5b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080693 Jun 02 16:25:45.405968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 827/1522] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:45 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:46.239685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7a7b41ba-32ba-4f81-823c-8fc5c3ea11c1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:46.240604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7a7b41ba-32ba-4f81-823c-8fc5c3ea11c1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:46.247711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a7b41ba-32ba-4f81-823c-8fc5c3ea11c1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:46.248153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a7b41ba-32ba-4f81-823c-8fc5c3ea11c1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:46.248914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a7b41ba-32ba-4f81-823c-8fc5c3ea11c1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:46.249348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a7b41ba-32ba-4f81-823c-8fc5c3ea11c1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:46.278285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7a7b41ba-32ba-4f81-823c-8fc5c3ea11c1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042432 Jun 02 16:25:46.278828 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 828/1523] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:46.421849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e15b6f72-0686-4a9b-a074-3a571de7b1c4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:46.422491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e15b6f72-0686-4a9b-a074-3a571de7b1c4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:46.428521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e15b6f72-0686-4a9b-a074-3a571de7b1c4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:46.429006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e15b6f72-0686-4a9b-a074-3a571de7b1c4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:46.429770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e15b6f72-0686-4a9b-a074-3a571de7b1c4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:46.430238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e15b6f72-0686-4a9b-a074-3a571de7b1c4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:46.492908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e15b6f72-0686-4a9b-a074-3a571de7b1c4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:46.500301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e15b6f72-0686-4a9b-a074-3a571de7b1c4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082290 Jun 02 16:25:46.500860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 829/1524] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:46 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:47.289666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-43b9c3a3-9c94-4051-8ccd-552ce5095e93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:47.290615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-43b9c3a3-9c94-4051-8ccd-552ce5095e93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:47.297028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43b9c3a3-9c94-4051-8ccd-552ce5095e93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:47.297463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43b9c3a3-9c94-4051-8ccd-552ce5095e93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:47.298259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43b9c3a3-9c94-4051-8ccd-552ce5095e93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:47.298706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43b9c3a3-9c94-4051-8ccd-552ce5095e93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:47.327635 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-43b9c3a3-9c94-4051-8ccd-552ce5095e93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042691 Jun 02 16:25:47.328195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 830/1525] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:47 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:47.517015 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c81bf428-85b5-444b-93de-facf42868ef9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:47.517558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c81bf428-85b5-444b-93de-facf42868ef9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:47.524091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c81bf428-85b5-444b-93de-facf42868ef9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:47.524541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c81bf428-85b5-444b-93de-facf42868ef9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:47.525295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c81bf428-85b5-444b-93de-facf42868ef9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:47.525729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c81bf428-85b5-444b-93de-facf42868ef9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:47.584312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c81bf428-85b5-444b-93de-facf42868ef9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:47.592579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c81bf428-85b5-444b-93de-facf42868ef9 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079333 Jun 02 16:25:47.593136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 831/1526] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:47 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:48.341023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d2557cb3-2529-43aa-8e0d-affe876280ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:48.341971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d2557cb3-2529-43aa-8e0d-affe876280ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:48.348644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2557cb3-2529-43aa-8e0d-affe876280ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:48.349089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2557cb3-2529-43aa-8e0d-affe876280ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:48.349985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2557cb3-2529-43aa-8e0d-affe876280ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:48.351078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2557cb3-2529-43aa-8e0d-affe876280ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:48.379879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d2557cb3-2529-43aa-8e0d-affe876280ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043875 Jun 02 16:25:48.380413 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 832/1527] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:48 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:48.616417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3bcc491c-8211-442e-86ce-580b73122c1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:48.616417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3bcc491c-8211-442e-86ce-580b73122c1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:48.616730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3bcc491c-8211-442e-86ce-580b73122c1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:48.617144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3bcc491c-8211-442e-86ce-580b73122c1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:48.617902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3bcc491c-8211-442e-86ce-580b73122c1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:48.618365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3bcc491c-8211-442e-86ce-580b73122c1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:48.679613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3bcc491c-8211-442e-86ce-580b73122c1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:48.687142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3bcc491c-8211-442e-86ce-580b73122c1d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081417 Jun 02 16:25:48.687752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 833/1528] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:48 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:49.391801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-30612271-501c-47cf-b74b-cae191abab7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:49.392713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-30612271-501c-47cf-b74b-cae191abab7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:49.399803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30612271-501c-47cf-b74b-cae191abab7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:49.400243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30612271-501c-47cf-b74b-cae191abab7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:49.400988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30612271-501c-47cf-b74b-cae191abab7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:49.401417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-30612271-501c-47cf-b74b-cae191abab7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:49.430061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-30612271-501c-47cf-b74b-cae191abab7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042184 Jun 02 16:25:49.430557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 834/1529] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:49.705089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7a845d0c-268a-421f-bfce-6cdfb25a3675 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:49.705615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7a845d0c-268a-421f-bfce-6cdfb25a3675 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:49.712371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a845d0c-268a-421f-bfce-6cdfb25a3675 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:49.712816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a845d0c-268a-421f-bfce-6cdfb25a3675 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:49.713568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a845d0c-268a-421f-bfce-6cdfb25a3675 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:49.714005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a845d0c-268a-421f-bfce-6cdfb25a3675 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:49.774063 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7a845d0c-268a-421f-bfce-6cdfb25a3675 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:49.781375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7a845d0c-268a-421f-bfce-6cdfb25a3675 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080249 Jun 02 16:25:49.781923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 835/1530] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:49 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:50.440975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-22c26fd6-8b93-4ef3-b828-c7bb2fd6394e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:50.441863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-22c26fd6-8b93-4ef3-b828-c7bb2fd6394e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:50.449179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22c26fd6-8b93-4ef3-b828-c7bb2fd6394e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:50.449632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22c26fd6-8b93-4ef3-b828-c7bb2fd6394e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:50.450468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22c26fd6-8b93-4ef3-b828-c7bb2fd6394e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:50.450906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-22c26fd6-8b93-4ef3-b828-c7bb2fd6394e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:50.481707 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-22c26fd6-8b93-4ef3-b828-c7bb2fd6394e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Jun 02 16:25:50.482282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 836/1531] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:50.798852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c0c58a6c-763c-4bed-88b3-c182e6a46c41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:50.799464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c0c58a6c-763c-4bed-88b3-c182e6a46c41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:50.805564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0c58a6c-763c-4bed-88b3-c182e6a46c41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:50.806014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0c58a6c-763c-4bed-88b3-c182e6a46c41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:50.806809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0c58a6c-763c-4bed-88b3-c182e6a46c41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:50.807247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0c58a6c-763c-4bed-88b3-c182e6a46c41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:50.870529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c0c58a6c-763c-4bed-88b3-c182e6a46c41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:50.873835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:25:50.878047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c0c58a6c-763c-4bed-88b3-c182e6a46c41 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083062 Jun 02 16:25:50.878624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 837/1532] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:50 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:51.493321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-872cdd6d-5ab4-4170-b5c9-c81c2cbfad77 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:51.494273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-872cdd6d-5ab4-4170-b5c9-c81c2cbfad77 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:51.500816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-872cdd6d-5ab4-4170-b5c9-c81c2cbfad77 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:51.501278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-872cdd6d-5ab4-4170-b5c9-c81c2cbfad77 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:51.502042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-872cdd6d-5ab4-4170-b5c9-c81c2cbfad77 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:51.502507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-872cdd6d-5ab4-4170-b5c9-c81c2cbfad77 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:51.531711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-872cdd6d-5ab4-4170-b5c9-c81c2cbfad77 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042823 Jun 02 16:25:51.532247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 838/1533] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:51.895647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-54b33186-d4c0-4102-82e0-840d906ddd11 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:51.896172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-54b33186-d4c0-4102-82e0-840d906ddd11 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:51.902359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54b33186-d4c0-4102-82e0-840d906ddd11 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:51.902808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54b33186-d4c0-4102-82e0-840d906ddd11 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:51.903568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54b33186-d4c0-4102-82e0-840d906ddd11 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:51.904003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54b33186-d4c0-4102-82e0-840d906ddd11 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:52.135721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=6 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:25:52.213649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-54b33186-d4c0-4102-82e0-840d906ddd11 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:52.221449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-54b33186-d4c0-4102-82e0-840d906ddd11 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.329706 Jun 02 16:25:52.222003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 839/1534] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:51 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:52.544088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-74582cb6-dadb-4e24-bdff-2c2313943c1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:52.545053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-74582cb6-dadb-4e24-bdff-2c2313943c1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:52.551465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74582cb6-dadb-4e24-bdff-2c2313943c1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:52.551920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74582cb6-dadb-4e24-bdff-2c2313943c1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:52.552692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74582cb6-dadb-4e24-bdff-2c2313943c1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:52.553133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74582cb6-dadb-4e24-bdff-2c2313943c1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:52.581091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-74582cb6-dadb-4e24-bdff-2c2313943c1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041067 Jun 02 16:25:52.581633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 840/1535] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:52 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:53.141914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:25:53.238900 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-abf5cc8b-5b42-4ed8-a9d4-640cb6680c59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:53.239707 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-abf5cc8b-5b42-4ed8-a9d4-640cb6680c59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:53.245751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-abf5cc8b-5b42-4ed8-a9d4-640cb6680c59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:53.246334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-abf5cc8b-5b42-4ed8-a9d4-640cb6680c59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:53.247095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-abf5cc8b-5b42-4ed8-a9d4-640cb6680c59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:53.247532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-abf5cc8b-5b42-4ed8-a9d4-640cb6680c59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:53.307468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-abf5cc8b-5b42-4ed8-a9d4-640cb6680c59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:53.314854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-abf5cc8b-5b42-4ed8-a9d4-640cb6680c59 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.079793 Jun 02 16:25:53.315416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 841/1536] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:53 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:53.592973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6dc1ef60-2097-407b-a993-82cc15427166 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:53.593901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6dc1ef60-2097-407b-a993-82cc15427166 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:53.601187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dc1ef60-2097-407b-a993-82cc15427166 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:53.601639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dc1ef60-2097-407b-a993-82cc15427166 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:53.602436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dc1ef60-2097-407b-a993-82cc15427166 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:53.602881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dc1ef60-2097-407b-a993-82cc15427166 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:53.632820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6dc1ef60-2097-407b-a993-82cc15427166 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Jun 02 16:25:53.633357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 842/1537] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:53 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:54.331594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-79cfd27c-4ec2-4b54-9498-91f9a7b12bde tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:54.332215 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-79cfd27c-4ec2-4b54-9498-91f9a7b12bde tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:54.338871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79cfd27c-4ec2-4b54-9498-91f9a7b12bde tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:54.339329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79cfd27c-4ec2-4b54-9498-91f9a7b12bde tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:54.340093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79cfd27c-4ec2-4b54-9498-91f9a7b12bde tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:54.340536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79cfd27c-4ec2-4b54-9498-91f9a7b12bde tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:54.402350 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-79cfd27c-4ec2-4b54-9498-91f9a7b12bde tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:54.409789 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-79cfd27c-4ec2-4b54-9498-91f9a7b12bde tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082027 Jun 02 16:25:54.410375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 843/1538] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:54 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:54.644207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-538f1d89-ec63-4688-a37f-0a7e6360e207 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:54.645134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-538f1d89-ec63-4688-a37f-0a7e6360e207 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:54.652449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-538f1d89-ec63-4688-a37f-0a7e6360e207 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:54.652909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-538f1d89-ec63-4688-a37f-0a7e6360e207 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:54.653703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-538f1d89-ec63-4688-a37f-0a7e6360e207 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:54.654170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-538f1d89-ec63-4688-a37f-0a7e6360e207 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:54.684413 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-538f1d89-ec63-4688-a37f-0a7e6360e207 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Jun 02 16:25:54.684954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 844/1539] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:54 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:55.427569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8ddc582a-fe11-481e-a89b-a172b9e3ba69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:55.428622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8ddc582a-fe11-481e-a89b-a172b9e3ba69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:55.434690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddc582a-fe11-481e-a89b-a172b9e3ba69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:55.435138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddc582a-fe11-481e-a89b-a172b9e3ba69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:55.435892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddc582a-fe11-481e-a89b-a172b9e3ba69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:55.436324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ddc582a-fe11-481e-a89b-a172b9e3ba69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:55.497157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8ddc582a-fe11-481e-a89b-a172b9e3ba69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:55.504683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8ddc582a-fe11-481e-a89b-a172b9e3ba69 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081037 Jun 02 16:25:55.505235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 845/1540] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:55 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:55.696732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f4ac58a8-1810-4437-a255-d60bc82c9c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:55.697738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f4ac58a8-1810-4437-a255-d60bc82c9c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:55.704227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f4ac58a8-1810-4437-a255-d60bc82c9c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:55.704680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f4ac58a8-1810-4437-a255-d60bc82c9c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:55.705455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f4ac58a8-1810-4437-a255-d60bc82c9c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:55.705896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f4ac58a8-1810-4437-a255-d60bc82c9c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:55.737032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f4ac58a8-1810-4437-a255-d60bc82c9c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Jun 02 16:25:55.737637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 846/1541] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:56.523401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-29e0f2a2-3e42-4447-b41e-47a2eae22693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:56.523943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-29e0f2a2-3e42-4447-b41e-47a2eae22693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:56.530091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29e0f2a2-3e42-4447-b41e-47a2eae22693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:56.530556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29e0f2a2-3e42-4447-b41e-47a2eae22693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:56.531324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29e0f2a2-3e42-4447-b41e-47a2eae22693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:56.531768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29e0f2a2-3e42-4447-b41e-47a2eae22693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:56.594652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-29e0f2a2-3e42-4447-b41e-47a2eae22693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:56.602813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-29e0f2a2-3e42-4447-b41e-47a2eae22693 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083615 Jun 02 16:25:56.603375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 847/1542] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:56 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:56.748934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9ce7f3b0-585a-4a6e-b8bd-4f7df65f9924 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:56.752412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9ce7f3b0-585a-4a6e-b8bd-4f7df65f9924 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:56.756432 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ce7f3b0-585a-4a6e-b8bd-4f7df65f9924 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:56.756889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ce7f3b0-585a-4a6e-b8bd-4f7df65f9924 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:56.757660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ce7f3b0-585a-4a6e-b8bd-4f7df65f9924 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:56.758121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ce7f3b0-585a-4a6e-b8bd-4f7df65f9924 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:56.786307 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9ce7f3b0-585a-4a6e-b8bd-4f7df65f9924 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041139 Jun 02 16:25:56.786783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 848/1543] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:57.620628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-04387179-f3ce-4cd6-b155-93171aecb265 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:57.621168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-04387179-f3ce-4cd6-b155-93171aecb265 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:57.627352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04387179-f3ce-4cd6-b155-93171aecb265 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:57.627806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04387179-f3ce-4cd6-b155-93171aecb265 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:57.628573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04387179-f3ce-4cd6-b155-93171aecb265 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:57.629019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04387179-f3ce-4cd6-b155-93171aecb265 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:57.688953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-04387179-f3ce-4cd6-b155-93171aecb265 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:57.696958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-04387179-f3ce-4cd6-b155-93171aecb265 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080274 Jun 02 16:25:57.697516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 849/1544] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:57 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:57.798006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-88b3ff96-429e-4ead-9e77-7282bf079638 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:57.798952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-88b3ff96-429e-4ead-9e77-7282bf079638 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:57.805891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-88b3ff96-429e-4ead-9e77-7282bf079638 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:57.806379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-88b3ff96-429e-4ead-9e77-7282bf079638 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:57.807148 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-88b3ff96-429e-4ead-9e77-7282bf079638 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:57.807597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-88b3ff96-429e-4ead-9e77-7282bf079638 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:57.836107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-88b3ff96-429e-4ead-9e77-7282bf079638 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041823 Jun 02 16:25:57.836644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 850/1545] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:57 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:58.714324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9c007eea-525c-48f4-8b7a-33e6fe58400e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:58.714938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9c007eea-525c-48f4-8b7a-33e6fe58400e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:58.721155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c007eea-525c-48f4-8b7a-33e6fe58400e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:58.721610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c007eea-525c-48f4-8b7a-33e6fe58400e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:58.722393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c007eea-525c-48f4-8b7a-33e6fe58400e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:58.722833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c007eea-525c-48f4-8b7a-33e6fe58400e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:58.783458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9c007eea-525c-48f4-8b7a-33e6fe58400e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:58.791019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9c007eea-525c-48f4-8b7a-33e6fe58400e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080595 Jun 02 16:25:58.791586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 851/1546] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:58 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:58.847949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-51e7a4f0-5783-49be-ae1a-7a1fb0732c50 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:58.848860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-51e7a4f0-5783-49be-ae1a-7a1fb0732c50 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:58.855505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51e7a4f0-5783-49be-ae1a-7a1fb0732c50 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:58.855959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51e7a4f0-5783-49be-ae1a-7a1fb0732c50 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:58.856716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51e7a4f0-5783-49be-ae1a-7a1fb0732c50 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:58.857218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51e7a4f0-5783-49be-ae1a-7a1fb0732c50 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:58.887002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-51e7a4f0-5783-49be-ae1a-7a1fb0732c50 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043350 Jun 02 16:25:58.887543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 852/1547] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:58 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:25:59.807714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b3610666-f968-4ac0-9a9b-5dd7c138febb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:59.808346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b3610666-f968-4ac0-9a9b-5dd7c138febb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:59.814327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3610666-f968-4ac0-9a9b-5dd7c138febb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:59.814774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3610666-f968-4ac0-9a9b-5dd7c138febb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:59.815525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3610666-f968-4ac0-9a9b-5dd7c138febb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:59.815953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b3610666-f968-4ac0-9a9b-5dd7c138febb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:59.881694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b3610666-f968-4ac0-9a9b-5dd7c138febb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:25:59.889077 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b3610666-f968-4ac0-9a9b-5dd7c138febb tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085218 Jun 02 16:25:59.889629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 853/1548] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:25:59 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:25:59.898354 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ef7739f8-6e34-4ae5-86cf-c58e6ccec259 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:25:59.899284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ef7739f8-6e34-4ae5-86cf-c58e6ccec259 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:25:59.904995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef7739f8-6e34-4ae5-86cf-c58e6ccec259 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:59.905437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef7739f8-6e34-4ae5-86cf-c58e6ccec259 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:59.906219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef7739f8-6e34-4ae5-86cf-c58e6ccec259 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:25:59.906652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef7739f8-6e34-4ae5-86cf-c58e6ccec259 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:25:59.923288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:25:59.935322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ef7739f8-6e34-4ae5-86cf-c58e6ccec259 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041059 Jun 02 16:25:59.936385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 854/1549] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:25:59 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:26:00.906459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e1781cf0-8e5f-42e2-a916-0c7100717397 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:00.907078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e1781cf0-8e5f-42e2-a916-0c7100717397 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:00.913740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1781cf0-8e5f-42e2-a916-0c7100717397 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:00.914212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1781cf0-8e5f-42e2-a916-0c7100717397 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:00.914970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1781cf0-8e5f-42e2-a916-0c7100717397 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:00.915404 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1781cf0-8e5f-42e2-a916-0c7100717397 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:00.978892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e1781cf0-8e5f-42e2-a916-0c7100717397 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:00.986207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e1781cf0-8e5f-42e2-a916-0c7100717397 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083884 Jun 02 16:26:00.986757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 855/1550] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:00 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:00.991918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6f1cac4e-bceb-40e7-9ade-7572fd7cb7ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:00.992801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6f1cac4e-bceb-40e7-9ade-7572fd7cb7ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:00.998558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f1cac4e-bceb-40e7-9ade-7572fd7cb7ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:00.999014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f1cac4e-bceb-40e7-9ade-7572fd7cb7ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:00.999788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f1cac4e-bceb-40e7-9ade-7572fd7cb7ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:01.000230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f1cac4e-bceb-40e7-9ade-7572fd7cb7ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:01.029041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6f1cac4e-bceb-40e7-9ade-7572fd7cb7ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041317 Jun 02 16:26:01.029611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 856/1551] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:02.003775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f0740ac4-af5f-46f4-8d1e-5669622f544e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:02.004468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f0740ac4-af5f-46f4-8d1e-5669622f544e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:02.011416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0740ac4-af5f-46f4-8d1e-5669622f544e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:02.011868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0740ac4-af5f-46f4-8d1e-5669622f544e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:02.012824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0740ac4-af5f-46f4-8d1e-5669622f544e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:02.013269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0740ac4-af5f-46f4-8d1e-5669622f544e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:02.073590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f0740ac4-af5f-46f4-8d1e-5669622f544e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:02.080946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f0740ac4-af5f-46f4-8d1e-5669622f544e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081104 Jun 02 16:26:02.081499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 857/1552] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:01 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:02.086574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6612d059-8105-40be-8d22-ef8b131aa610 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:02.087474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6612d059-8105-40be-8d22-ef8b131aa610 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:02.092982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6612d059-8105-40be-8d22-ef8b131aa610 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:02.093433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6612d059-8105-40be-8d22-ef8b131aa610 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:02.094471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6612d059-8105-40be-8d22-ef8b131aa610 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:02.094921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6612d059-8105-40be-8d22-ef8b131aa610 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:02.123370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6612d059-8105-40be-8d22-ef8b131aa610 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040909 Jun 02 16:26:02.123944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 858/1553] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:03.098835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f3978852-5592-4b24-9259-30b8fa0d036b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:03.099539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f3978852-5592-4b24-9259-30b8fa0d036b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:03.105824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3978852-5592-4b24-9259-30b8fa0d036b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:03.106315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3978852-5592-4b24-9259-30b8fa0d036b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:03.107076 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3978852-5592-4b24-9259-30b8fa0d036b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:03.107516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3978852-5592-4b24-9259-30b8fa0d036b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:03.168285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f3978852-5592-4b24-9259-30b8fa0d036b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:03.175757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f3978852-5592-4b24-9259-30b8fa0d036b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081191 Jun 02 16:26:03.176318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 859/1554] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:03 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:03.181506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-42be0165-4382-423b-a3ad-3a1a21277c0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:03.182435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-42be0165-4382-423b-a3ad-3a1a21277c0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:03.189668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42be0165-4382-423b-a3ad-3a1a21277c0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:03.190303 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42be0165-4382-423b-a3ad-3a1a21277c0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:03.191193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42be0165-4382-423b-a3ad-3a1a21277c0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:03.191734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-42be0165-4382-423b-a3ad-3a1a21277c0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:03.221186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-42be0165-4382-423b-a3ad-3a1a21277c0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Jun 02 16:26:03.221726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 860/1555] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:03 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:04.193509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-77900c2e-f655-4a8f-afe1-5dad60b3b01e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:04.194255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-77900c2e-f655-4a8f-afe1-5dad60b3b01e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:04.200739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77900c2e-f655-4a8f-afe1-5dad60b3b01e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:04.201184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77900c2e-f655-4a8f-afe1-5dad60b3b01e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:04.201943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77900c2e-f655-4a8f-afe1-5dad60b3b01e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:04.202412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77900c2e-f655-4a8f-afe1-5dad60b3b01e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:04.262369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-77900c2e-f655-4a8f-afe1-5dad60b3b01e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:04.269676 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-77900c2e-f655-4a8f-afe1-5dad60b3b01e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080541 Jun 02 16:26:04.270261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 861/1556] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:04 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:04.275274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-98fea955-bf81-4b3b-8e48-9337b42b787e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:04.276168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-98fea955-bf81-4b3b-8e48-9337b42b787e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:04.281746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-98fea955-bf81-4b3b-8e48-9337b42b787e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:04.282223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-98fea955-bf81-4b3b-8e48-9337b42b787e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:04.282978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-98fea955-bf81-4b3b-8e48-9337b42b787e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:04.283408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-98fea955-bf81-4b3b-8e48-9337b42b787e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:04.310944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-98fea955-bf81-4b3b-8e48-9337b42b787e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039714 Jun 02 16:26:04.311479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 862/1557] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:04 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:05.287584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d0db2e19-9e70-47cb-bbc4-eb5d7d1e34a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:05.288259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d0db2e19-9e70-47cb-bbc4-eb5d7d1e34a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:05.294941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0db2e19-9e70-47cb-bbc4-eb5d7d1e34a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:05.295390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0db2e19-9e70-47cb-bbc4-eb5d7d1e34a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:05.296177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0db2e19-9e70-47cb-bbc4-eb5d7d1e34a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:05.296610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0db2e19-9e70-47cb-bbc4-eb5d7d1e34a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:05.362510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d0db2e19-9e70-47cb-bbc4-eb5d7d1e34a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:05.371221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d0db2e19-9e70-47cb-bbc4-eb5d7d1e34a6 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.088032 Jun 02 16:26:05.371786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 863/1558] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:05 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:05.376770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c837819f-ee31-4a00-9d3e-35650d24e7b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:05.377742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c837819f-ee31-4a00-9d3e-35650d24e7b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:05.384999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c837819f-ee31-4a00-9d3e-35650d24e7b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:05.385447 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c837819f-ee31-4a00-9d3e-35650d24e7b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:05.386260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c837819f-ee31-4a00-9d3e-35650d24e7b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:05.386694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c837819f-ee31-4a00-9d3e-35650d24e7b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:05.416179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c837819f-ee31-4a00-9d3e-35650d24e7b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043354 Jun 02 16:26:05.416745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 864/1559] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:06.389336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-06cef3c7-03e3-43ba-be0b-7c862364fdd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:06.390005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-06cef3c7-03e3-43ba-be0b-7c862364fdd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:06.397101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06cef3c7-03e3-43ba-be0b-7c862364fdd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:06.397553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06cef3c7-03e3-43ba-be0b-7c862364fdd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:06.398338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06cef3c7-03e3-43ba-be0b-7c862364fdd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:06.398769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06cef3c7-03e3-43ba-be0b-7c862364fdd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:06.459983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-06cef3c7-03e3-43ba-be0b-7c862364fdd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:06.467453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-06cef3c7-03e3-43ba-be0b-7c862364fdd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081907 Jun 02 16:26:06.468003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 865/1560] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:06 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:06.472735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ed156c99-84d6-4718-b8c5-48f046f21c84 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:06.473625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ed156c99-84d6-4718-b8c5-48f046f21c84 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:06.479570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ed156c99-84d6-4718-b8c5-48f046f21c84 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:06.480053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ed156c99-84d6-4718-b8c5-48f046f21c84 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:06.480800 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ed156c99-84d6-4718-b8c5-48f046f21c84 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:06.481269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ed156c99-84d6-4718-b8c5-48f046f21c84 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:06.510006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ed156c99-84d6-4718-b8c5-48f046f21c84 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041043 Jun 02 16:26:06.510620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 866/1561] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:07.484700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2cc0bfca-1ef7-408a-8d44-2388b64982c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:07.485371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2cc0bfca-1ef7-408a-8d44-2388b64982c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:07.492098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2cc0bfca-1ef7-408a-8d44-2388b64982c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:07.492544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2cc0bfca-1ef7-408a-8d44-2388b64982c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:07.493299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2cc0bfca-1ef7-408a-8d44-2388b64982c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:07.493731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2cc0bfca-1ef7-408a-8d44-2388b64982c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:07.554874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2cc0bfca-1ef7-408a-8d44-2388b64982c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:07.563847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2cc0bfca-1ef7-408a-8d44-2388b64982c5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081449 Jun 02 16:26:07.563847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 867/1562] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:07 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:07.567452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ab983e97-8825-41cf-81af-1344c2ed19d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:07.569055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ab983e97-8825-41cf-81af-1344c2ed19d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:07.574711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ab983e97-8825-41cf-81af-1344c2ed19d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:07.575154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ab983e97-8825-41cf-81af-1344c2ed19d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:07.575901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ab983e97-8825-41cf-81af-1344c2ed19d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:07.576329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ab983e97-8825-41cf-81af-1344c2ed19d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:07.604876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ab983e97-8825-41cf-81af-1344c2ed19d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041050 Jun 02 16:26:07.605413 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 868/1563] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:08.579697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4fd928ed-60fb-4265-8d9b-b2d88d3a2c9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:08.580357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4fd928ed-60fb-4265-8d9b-b2d88d3a2c9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:08.586811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4fd928ed-60fb-4265-8d9b-b2d88d3a2c9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:08.587255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4fd928ed-60fb-4265-8d9b-b2d88d3a2c9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:08.588010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4fd928ed-60fb-4265-8d9b-b2d88d3a2c9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:08.588440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4fd928ed-60fb-4265-8d9b-b2d88d3a2c9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:08.650283 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4fd928ed-60fb-4265-8d9b-b2d88d3a2c9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:08.657700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4fd928ed-60fb-4265-8d9b-b2d88d3a2c9a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081901 Jun 02 16:26:08.658383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 869/1564] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:08 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:08.663765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b48b7c08-f477-46cf-9ee0-d2e9b65590ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:08.664664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b48b7c08-f477-46cf-9ee0-d2e9b65590ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:08.670247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b48b7c08-f477-46cf-9ee0-d2e9b65590ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:08.670689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b48b7c08-f477-46cf-9ee0-d2e9b65590ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:08.671437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b48b7c08-f477-46cf-9ee0-d2e9b65590ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:08.671874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b48b7c08-f477-46cf-9ee0-d2e9b65590ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:08.701137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b48b7c08-f477-46cf-9ee0-d2e9b65590ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041731 Jun 02 16:26:08.701671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 870/1565] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:08 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:09.675311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cd910abb-ece0-4ddb-96a6-d652ecaf61fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:09.675972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cd910abb-ece0-4ddb-96a6-d652ecaf61fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:09.679794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:26:09.683283 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd910abb-ece0-4ddb-96a6-d652ecaf61fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:09.683730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd910abb-ece0-4ddb-96a6-d652ecaf61fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:09.684493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd910abb-ece0-4ddb-96a6-d652ecaf61fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:09.684926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd910abb-ece0-4ddb-96a6-d652ecaf61fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:09.688873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:26:09.752457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cd910abb-ece0-4ddb-96a6-d652ecaf61fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:09.760754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cd910abb-ece0-4ddb-96a6-d652ecaf61fd tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.089327 Jun 02 16:26:09.761319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 871/1566] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:09 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:09.766170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-59e22927-5996-419a-b20a-7a00d32e7963 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:09.767070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-59e22927-5996-419a-b20a-7a00d32e7963 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:09.773726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59e22927-5996-419a-b20a-7a00d32e7963 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:09.774226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59e22927-5996-419a-b20a-7a00d32e7963 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:09.774999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59e22927-5996-419a-b20a-7a00d32e7963 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:09.775443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59e22927-5996-419a-b20a-7a00d32e7963 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:09.804999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-59e22927-5996-419a-b20a-7a00d32e7963 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042708 Jun 02 16:26:09.805545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 872/1567] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:10.777576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-33a84a10-8741-48c8-96d9-78cc68b49683 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:10.778233 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-33a84a10-8741-48c8-96d9-78cc68b49683 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:10.784660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33a84a10-8741-48c8-96d9-78cc68b49683 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:10.785113 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33a84a10-8741-48c8-96d9-78cc68b49683 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:10.785880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33a84a10-8741-48c8-96d9-78cc68b49683 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:10.786356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33a84a10-8741-48c8-96d9-78cc68b49683 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:10.849149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-33a84a10-8741-48c8-96d9-78cc68b49683 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:10.857141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-33a84a10-8741-48c8-96d9-78cc68b49683 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083433 Jun 02 16:26:10.857735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 873/1568] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:10 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:10.862267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8d98e2c8-0a47-4943-936b-37d4897d1a88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:10.863168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8d98e2c8-0a47-4943-936b-37d4897d1a88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:10.869352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d98e2c8-0a47-4943-936b-37d4897d1a88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:10.869796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d98e2c8-0a47-4943-936b-37d4897d1a88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:10.870570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d98e2c8-0a47-4943-936b-37d4897d1a88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:10.871002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d98e2c8-0a47-4943-936b-37d4897d1a88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:10.900227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8d98e2c8-0a47-4943-936b-37d4897d1a88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Jun 02 16:26:10.900762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 874/1569] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:10 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:11.875227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a193c4a6-9b6a-4e17-a7bc-0b14ae513ced tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:11.875865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a193c4a6-9b6a-4e17-a7bc-0b14ae513ced tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:11.882457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a193c4a6-9b6a-4e17-a7bc-0b14ae513ced tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:11.882912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a193c4a6-9b6a-4e17-a7bc-0b14ae513ced tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:11.883679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a193c4a6-9b6a-4e17-a7bc-0b14ae513ced tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:11.884120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a193c4a6-9b6a-4e17-a7bc-0b14ae513ced tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:11.945366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a193c4a6-9b6a-4e17-a7bc-0b14ae513ced tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:11.952949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a193c4a6-9b6a-4e17-a7bc-0b14ae513ced tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081681 Jun 02 16:26:11.953721 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 875/1570] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:11 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:11.958003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-518b2004-8a91-4fa4-8140-a1960d49b6cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:11.958936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-518b2004-8a91-4fa4-8140-a1960d49b6cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:11.965547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-518b2004-8a91-4fa4-8140-a1960d49b6cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:11.965996 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-518b2004-8a91-4fa4-8140-a1960d49b6cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:11.966816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-518b2004-8a91-4fa4-8140-a1960d49b6cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:11.967255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-518b2004-8a91-4fa4-8140-a1960d49b6cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:11.996771 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-518b2004-8a91-4fa4-8140-a1960d49b6cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042284 Jun 02 16:26:11.997329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 876/1571] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:11 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:12.970640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-15e9193f-ecfe-497a-a3a0-acee41ee679c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:12.971276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-15e9193f-ecfe-497a-a3a0-acee41ee679c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:12.978405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15e9193f-ecfe-497a-a3a0-acee41ee679c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:12.978860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15e9193f-ecfe-497a-a3a0-acee41ee679c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:12.979631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15e9193f-ecfe-497a-a3a0-acee41ee679c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:12.980068 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-15e9193f-ecfe-497a-a3a0-acee41ee679c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:13.040843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-15e9193f-ecfe-497a-a3a0-acee41ee679c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:13.048378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-15e9193f-ecfe-497a-a3a0-acee41ee679c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081984 Jun 02 16:26:13.048942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 877/1572] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:12 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:13.054134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-619d98d6-6acc-421f-b50b-866532fc63e5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:13.055045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-619d98d6-6acc-421f-b50b-866532fc63e5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:13.060686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-619d98d6-6acc-421f-b50b-866532fc63e5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:13.061135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-619d98d6-6acc-421f-b50b-866532fc63e5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:13.061943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-619d98d6-6acc-421f-b50b-866532fc63e5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:13.062406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-619d98d6-6acc-421f-b50b-866532fc63e5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:13.089949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-619d98d6-6acc-421f-b50b-866532fc63e5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040029 Jun 02 16:26:13.090521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 878/1573] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:13 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:14.066344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-03542935-20de-4a8c-9ef5-5ec619c93b42 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:14.067022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-03542935-20de-4a8c-9ef5-5ec619c93b42 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:14.074034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03542935-20de-4a8c-9ef5-5ec619c93b42 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:14.074518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03542935-20de-4a8c-9ef5-5ec619c93b42 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:14.075280 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03542935-20de-4a8c-9ef5-5ec619c93b42 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:14.075717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03542935-20de-4a8c-9ef5-5ec619c93b42 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:14.139874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-03542935-20de-4a8c-9ef5-5ec619c93b42 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:14.147239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-03542935-20de-4a8c-9ef5-5ec619c93b42 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084835 Jun 02 16:26:14.147796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 879/1574] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:14 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:14.152474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-66fdf026-8be1-4dc1-89e2-b6ea50d061a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:14.153370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-66fdf026-8be1-4dc1-89e2-b6ea50d061a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:14.158893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66fdf026-8be1-4dc1-89e2-b6ea50d061a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:14.159337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66fdf026-8be1-4dc1-89e2-b6ea50d061a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:14.160088 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66fdf026-8be1-4dc1-89e2-b6ea50d061a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:14.160523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66fdf026-8be1-4dc1-89e2-b6ea50d061a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:14.189413 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-66fdf026-8be1-4dc1-89e2-b6ea50d061a3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040539 Jun 02 16:26:14.189970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 880/1575] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:15.164067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-527a88e7-01be-402e-acfb-d172b73cccd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:15.164705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-527a88e7-01be-402e-acfb-d172b73cccd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:15.171179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-527a88e7-01be-402e-acfb-d172b73cccd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:15.171626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-527a88e7-01be-402e-acfb-d172b73cccd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:15.172839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-527a88e7-01be-402e-acfb-d172b73cccd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:15.172839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-527a88e7-01be-402e-acfb-d172b73cccd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:15.235165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-527a88e7-01be-402e-acfb-d172b73cccd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:15.242592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-527a88e7-01be-402e-acfb-d172b73cccd1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082543 Jun 02 16:26:15.243151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 881/1576] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:15 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:15.247657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fb26e8f1-84ba-450a-9bf2-d6222d051185 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:15.248564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fb26e8f1-84ba-450a-9bf2-d6222d051185 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:15.254358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb26e8f1-84ba-450a-9bf2-d6222d051185 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:15.254807 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb26e8f1-84ba-450a-9bf2-d6222d051185 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:15.255566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb26e8f1-84ba-450a-9bf2-d6222d051185 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:15.256000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fb26e8f1-84ba-450a-9bf2-d6222d051185 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:15.287023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fb26e8f1-84ba-450a-9bf2-d6222d051185 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042885 Jun 02 16:26:15.287557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 882/1577] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:15 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:16.259512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fdda1307-8e6a-4d30-b95a-376d3a47af8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:16.260132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fdda1307-8e6a-4d30-b95a-376d3a47af8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:16.266634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fdda1307-8e6a-4d30-b95a-376d3a47af8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:16.267090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fdda1307-8e6a-4d30-b95a-376d3a47af8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:16.267863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fdda1307-8e6a-4d30-b95a-376d3a47af8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:16.268304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fdda1307-8e6a-4d30-b95a-376d3a47af8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:16.329137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fdda1307-8e6a-4d30-b95a-376d3a47af8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:16.337305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fdda1307-8e6a-4d30-b95a-376d3a47af8e tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082198 Jun 02 16:26:16.337873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 883/1578] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:16 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:16.342344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d75a9b9e-ba71-46b4-99d1-4a753a8a107d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:16.343253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d75a9b9e-ba71-46b4-99d1-4a753a8a107d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:16.349114 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d75a9b9e-ba71-46b4-99d1-4a753a8a107d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:16.349570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d75a9b9e-ba71-46b4-99d1-4a753a8a107d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:16.350358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d75a9b9e-ba71-46b4-99d1-4a753a8a107d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:16.350806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d75a9b9e-ba71-46b4-99d1-4a753a8a107d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:16.379190 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d75a9b9e-ba71-46b4-99d1-4a753a8a107d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040316 Jun 02 16:26:16.379732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 884/1579] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:17.354182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9af175ce-d36f-44e5-a763-694e3196dcb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:17.354889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9af175ce-d36f-44e5-a763-694e3196dcb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:17.361111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af175ce-d36f-44e5-a763-694e3196dcb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:17.361554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af175ce-d36f-44e5-a763-694e3196dcb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:17.362342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af175ce-d36f-44e5-a763-694e3196dcb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:17.362776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9af175ce-d36f-44e5-a763-694e3196dcb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:17.423678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9af175ce-d36f-44e5-a763-694e3196dcb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:17.431037 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9af175ce-d36f-44e5-a763-694e3196dcb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081285 Jun 02 16:26:17.432263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 885/1580] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:17 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:17.436719 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-413a5dcb-3544-4c4f-ac76-3a79283726e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:17.437609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-413a5dcb-3544-4c4f-ac76-3a79283726e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:17.443112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-413a5dcb-3544-4c4f-ac76-3a79283726e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:17.443556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-413a5dcb-3544-4c4f-ac76-3a79283726e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:17.444309 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-413a5dcb-3544-4c4f-ac76-3a79283726e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:17.444748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-413a5dcb-3544-4c4f-ac76-3a79283726e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:17.472749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-413a5dcb-3544-4c4f-ac76-3a79283726e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039463 Jun 02 16:26:17.473286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 886/1581] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:18.449157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a6238073-7f6f-40bb-83a3-d7bfb785aab5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:18.449848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a6238073-7f6f-40bb-83a3-d7bfb785aab5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:18.456288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6238073-7f6f-40bb-83a3-d7bfb785aab5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:18.456735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6238073-7f6f-40bb-83a3-d7bfb785aab5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:18.457497 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6238073-7f6f-40bb-83a3-d7bfb785aab5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:18.457931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a6238073-7f6f-40bb-83a3-d7bfb785aab5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:18.521866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a6238073-7f6f-40bb-83a3-d7bfb785aab5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:18.525203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:26:18.529478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a6238073-7f6f-40bb-83a3-d7bfb785aab5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084855 Jun 02 16:26:18.530033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 887/1582] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:18 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:18.534469 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3341f28e-e604-4c48-957b-6217c1de607c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:18.535362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3341f28e-e604-4c48-957b-6217c1de607c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:18.541450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3341f28e-e604-4c48-957b-6217c1de607c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:18.545661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3341f28e-e604-4c48-957b-6217c1de607c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:18.545661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3341f28e-e604-4c48-957b-6217c1de607c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:18.545661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3341f28e-e604-4c48-957b-6217c1de607c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:18.572499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3341f28e-e604-4c48-957b-6217c1de607c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040879 Jun 02 16:26:18.573322 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 888/1583] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:19.546543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-81ebe5aa-2df3-4242-b2a7-359bbbb64c8a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:19.547168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-81ebe5aa-2df3-4242-b2a7-359bbbb64c8a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:19.553544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-81ebe5aa-2df3-4242-b2a7-359bbbb64c8a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:19.553997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-81ebe5aa-2df3-4242-b2a7-359bbbb64c8a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:19.554797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-81ebe5aa-2df3-4242-b2a7-359bbbb64c8a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:19.555242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-81ebe5aa-2df3-4242-b2a7-359bbbb64c8a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:19.620060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-81ebe5aa-2df3-4242-b2a7-359bbbb64c8a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:19.627554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-81ebe5aa-2df3-4242-b2a7-359bbbb64c8a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084959 Jun 02 16:26:19.628126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 889/1584] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:19 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:19.633386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-44898d4e-47c5-4a6b-9e76-e955aba39358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:19.634435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-44898d4e-47c5-4a6b-9e76-e955aba39358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:19.640115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-44898d4e-47c5-4a6b-9e76-e955aba39358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:19.640557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-44898d4e-47c5-4a6b-9e76-e955aba39358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:19.641308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-44898d4e-47c5-4a6b-9e76-e955aba39358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:19.641734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-44898d4e-47c5-4a6b-9e76-e955aba39358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:19.669795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-44898d4e-47c5-4a6b-9e76-e955aba39358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040692 Jun 02 16:26:19.670377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 890/1585] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:19 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:20.644430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6ca257da-2033-43b9-936c-a169871fc57d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:20.645101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6ca257da-2033-43b9-936c-a169871fc57d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:20.652546 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ca257da-2033-43b9-936c-a169871fc57d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:20.652991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ca257da-2033-43b9-936c-a169871fc57d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:20.653749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ca257da-2033-43b9-936c-a169871fc57d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:20.654212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ca257da-2033-43b9-936c-a169871fc57d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:20.714054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6ca257da-2033-43b9-936c-a169871fc57d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:20.721668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6ca257da-2033-43b9-936c-a169871fc57d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081150 Jun 02 16:26:20.722247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 891/1586] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:20 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:20.726669 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7fd6a1b0-8142-4b7a-ae16-a9f2005eef38 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:20.727560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7fd6a1b0-8142-4b7a-ae16-a9f2005eef38 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:20.733271 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7fd6a1b0-8142-4b7a-ae16-a9f2005eef38 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:20.733716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7fd6a1b0-8142-4b7a-ae16-a9f2005eef38 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:20.734511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7fd6a1b0-8142-4b7a-ae16-a9f2005eef38 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:20.734946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7fd6a1b0-8142-4b7a-ae16-a9f2005eef38 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:20.763776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7fd6a1b0-8142-4b7a-ae16-a9f2005eef38 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040566 Jun 02 16:26:20.764318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 892/1587] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:21.738841 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e60af27a-e9ee-4de3-805c-ab67fd9bac0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:21.739475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e60af27a-e9ee-4de3-805c-ab67fd9bac0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:21.746760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e60af27a-e9ee-4de3-805c-ab67fd9bac0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:21.747219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e60af27a-e9ee-4de3-805c-ab67fd9bac0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:21.748043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e60af27a-e9ee-4de3-805c-ab67fd9bac0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:21.748477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e60af27a-e9ee-4de3-805c-ab67fd9bac0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:21.810701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e60af27a-e9ee-4de3-805c-ab67fd9bac0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:21.818012 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e60af27a-e9ee-4de3-805c-ab67fd9bac0c tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083225 Jun 02 16:26:21.818602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 893/1588] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:21 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:21.823691 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5beb34e1-d5f8-4cc4-95f2-2695d045a475 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:21.824591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5beb34e1-d5f8-4cc4-95f2-2695d045a475 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:21.830196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5beb34e1-d5f8-4cc4-95f2-2695d045a475 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:21.830637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5beb34e1-d5f8-4cc4-95f2-2695d045a475 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:21.831390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5beb34e1-d5f8-4cc4-95f2-2695d045a475 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:21.831820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5beb34e1-d5f8-4cc4-95f2-2695d045a475 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:21.861183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5beb34e1-d5f8-4cc4-95f2-2695d045a475 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 Jun 02 16:26:21.861740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 894/1589] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:22.835476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3ba16dcd-4866-48d0-b2f7-ff328a592ec5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:22.836012 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3ba16dcd-4866-48d0-b2f7-ff328a592ec5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:22.843294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ba16dcd-4866-48d0-b2f7-ff328a592ec5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:22.843740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ba16dcd-4866-48d0-b2f7-ff328a592ec5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:22.844748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ba16dcd-4866-48d0-b2f7-ff328a592ec5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:22.845174 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ba16dcd-4866-48d0-b2f7-ff328a592ec5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:22.909506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3ba16dcd-4866-48d0-b2f7-ff328a592ec5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:22.917064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3ba16dcd-4866-48d0-b2f7-ff328a592ec5 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085565 Jun 02 16:26:22.917625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 895/1590] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:22 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:22.922117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8f4fae49-dca8-4ef5-9fff-228e6fcf3a17 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:22.923014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8f4fae49-dca8-4ef5-9fff-228e6fcf3a17 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:22.928812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f4fae49-dca8-4ef5-9fff-228e6fcf3a17 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:22.929270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f4fae49-dca8-4ef5-9fff-228e6fcf3a17 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:22.930042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f4fae49-dca8-4ef5-9fff-228e6fcf3a17 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:22.930541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8f4fae49-dca8-4ef5-9fff-228e6fcf3a17 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:22.959464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8f4fae49-dca8-4ef5-9fff-228e6fcf3a17 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040835 Jun 02 16:26:22.960069 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 896/1591] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:23.934204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e939f45d-43e5-4519-961a-39838d12f0d1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:23.934860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e939f45d-43e5-4519-961a-39838d12f0d1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:23.941225 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e939f45d-43e5-4519-961a-39838d12f0d1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:23.941678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e939f45d-43e5-4519-961a-39838d12f0d1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:23.942478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e939f45d-43e5-4519-961a-39838d12f0d1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:23.942917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e939f45d-43e5-4519-961a-39838d12f0d1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:24.005096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e939f45d-43e5-4519-961a-39838d12f0d1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:24.012522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e939f45d-43e5-4519-961a-39838d12f0d1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082417 Jun 02 16:26:24.013073 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 897/1592] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:23 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:24.017676 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c2629eb5-e56f-4c6d-96bd-fb0836a8b192 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:24.018603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c2629eb5-e56f-4c6d-96bd-fb0836a8b192 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:24.024066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2629eb5-e56f-4c6d-96bd-fb0836a8b192 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:24.024506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2629eb5-e56f-4c6d-96bd-fb0836a8b192 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:24.025769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2629eb5-e56f-4c6d-96bd-fb0836a8b192 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:24.026236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2629eb5-e56f-4c6d-96bd-fb0836a8b192 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:24.054793 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c2629eb5-e56f-4c6d-96bd-fb0836a8b192 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040766 Jun 02 16:26:24.055325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 898/1593] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:25.029532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9d0d9165-9c5d-44f2-9d12-7f95c22ef9e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:25.030334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9d0d9165-9c5d-44f2-9d12-7f95c22ef9e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:25.036532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d0d9165-9c5d-44f2-9d12-7f95c22ef9e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:25.036977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d0d9165-9c5d-44f2-9d12-7f95c22ef9e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:25.037755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d0d9165-9c5d-44f2-9d12-7f95c22ef9e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:25.038211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9d0d9165-9c5d-44f2-9d12-7f95c22ef9e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:25.099250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9d0d9165-9c5d-44f2-9d12-7f95c22ef9e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:25.106639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9d0d9165-9c5d-44f2-9d12-7f95c22ef9e4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081805 Jun 02 16:26:25.107198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 899/1594] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:25 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:25.111789 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eff11b02-7396-4819-990c-6618e6735e94 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:25.112684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eff11b02-7396-4819-990c-6618e6735e94 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:25.118180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eff11b02-7396-4819-990c-6618e6735e94 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:25.118804 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eff11b02-7396-4819-990c-6618e6735e94 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:25.119528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eff11b02-7396-4819-990c-6618e6735e94 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:25.119957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eff11b02-7396-4819-990c-6618e6735e94 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:25.147980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eff11b02-7396-4819-990c-6618e6735e94 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039755 Jun 02 16:26:25.148512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 900/1595] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:25 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:26.123747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8d3d5a28-4181-460e-985b-115f0e1ccd37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:26.124425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8d3d5a28-4181-460e-985b-115f0e1ccd37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:26.130874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d3d5a28-4181-460e-985b-115f0e1ccd37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:26.131338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d3d5a28-4181-460e-985b-115f0e1ccd37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:26.132096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d3d5a28-4181-460e-985b-115f0e1ccd37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:26.132536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8d3d5a28-4181-460e-985b-115f0e1ccd37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:26.193057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8d3d5a28-4181-460e-985b-115f0e1ccd37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:26.200868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8d3d5a28-4181-460e-985b-115f0e1ccd37 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081011 Jun 02 16:26:26.201422 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 901/1596] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:26 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:26:26.205836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-272ccca9-91b1-4ef8-8979-edb7082f3dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:26.206787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-272ccca9-91b1-4ef8-8979-edb7082f3dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:26.212830 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-272ccca9-91b1-4ef8-8979-edb7082f3dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:26.213433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-272ccca9-91b1-4ef8-8979-edb7082f3dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:26.214236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-272ccca9-91b1-4ef8-8979-edb7082f3dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:26.214674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-272ccca9-91b1-4ef8-8979-edb7082f3dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:26.243102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-272ccca9-91b1-4ef8-8979-edb7082f3dbf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 Jun 02 16:26:26.243754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 902/1597] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:27.218027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e10e5681-962a-4655-beff-03b9f9f9305b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:27.218683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e10e5681-962a-4655-beff-03b9f9f9305b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:27.225453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e10e5681-962a-4655-beff-03b9f9f9305b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:27.228920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e10e5681-962a-4655-beff-03b9f9f9305b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:27.228920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e10e5681-962a-4655-beff-03b9f9f9305b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:27.228920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e10e5681-962a-4655-beff-03b9f9f9305b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:27.290737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e10e5681-962a-4655-beff-03b9f9f9305b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:27.298477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e10e5681-962a-4655-beff-03b9f9f9305b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084631 Jun 02 16:26:27.299037 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 903/1598] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:27 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:27.303498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2c820f05-72d5-40f5-ab84-f4eb9b92fb04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:27.304389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2c820f05-72d5-40f5-ab84-f4eb9b92fb04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:27.310569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c820f05-72d5-40f5-ab84-f4eb9b92fb04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:27.311013 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c820f05-72d5-40f5-ab84-f4eb9b92fb04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:27.311761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c820f05-72d5-40f5-ab84-f4eb9b92fb04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:27.312192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2c820f05-72d5-40f5-ab84-f4eb9b92fb04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:27.328041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:26:27.339991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2c820f05-72d5-40f5-ab84-f4eb9b92fb04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039985 Jun 02 16:26:27.343398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 904/1599] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:28.316398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f536ec5d-60ea-438b-8219-86ac5fb12eb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:28.317046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f536ec5d-60ea-438b-8219-86ac5fb12eb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:28.324168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f536ec5d-60ea-438b-8219-86ac5fb12eb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:28.324617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f536ec5d-60ea-438b-8219-86ac5fb12eb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:28.325386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f536ec5d-60ea-438b-8219-86ac5fb12eb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:28.325804 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f536ec5d-60ea-438b-8219-86ac5fb12eb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:28.387943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f536ec5d-60ea-438b-8219-86ac5fb12eb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:28.395416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f536ec5d-60ea-438b-8219-86ac5fb12eb0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083223 Jun 02 16:26:28.395977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 905/1600] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:28 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:28.401091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-633a7ad9-9f84-4302-bddb-5313e715bcc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:28.402002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-633a7ad9-9f84-4302-bddb-5313e715bcc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:28.407551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-633a7ad9-9f84-4302-bddb-5313e715bcc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:28.408004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-633a7ad9-9f84-4302-bddb-5313e715bcc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:28.408770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-633a7ad9-9f84-4302-bddb-5313e715bcc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:28.409211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-633a7ad9-9f84-4302-bddb-5313e715bcc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:28.438726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-633a7ad9-9f84-4302-bddb-5313e715bcc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041711 Jun 02 16:26:28.439210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 906/1601] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:29.411546 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-faddc595-0ac2-44c0-8792-181cfc4b57e1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:29.412214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-faddc595-0ac2-44c0-8792-181cfc4b57e1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:29.418912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-faddc595-0ac2-44c0-8792-181cfc4b57e1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:29.419358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-faddc595-0ac2-44c0-8792-181cfc4b57e1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:29.420106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-faddc595-0ac2-44c0-8792-181cfc4b57e1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:29.420537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-faddc595-0ac2-44c0-8792-181cfc4b57e1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:29.481767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-faddc595-0ac2-44c0-8792-181cfc4b57e1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:29.489244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-faddc595-0ac2-44c0-8792-181cfc4b57e1 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081521 Jun 02 16:26:29.489809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 907/1602] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:29 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:29.494879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-87a6d0b5-e24c-48a3-a49a-3acb740f86b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:29.495792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-87a6d0b5-e24c-48a3-a49a-3acb740f86b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:29.501617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87a6d0b5-e24c-48a3-a49a-3acb740f86b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:29.502091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87a6d0b5-e24c-48a3-a49a-3acb740f86b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:29.502868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87a6d0b5-e24c-48a3-a49a-3acb740f86b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:29.503312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-87a6d0b5-e24c-48a3-a49a-3acb740f86b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:29.533364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-87a6d0b5-e24c-48a3-a49a-3acb740f86b9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042544 Jun 02 16:26:29.533909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 908/1603] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:30.507068 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ecb824a6-e9a4-4440-a935-c5f54901dac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:30.507709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ecb824a6-e9a4-4440-a935-c5f54901dac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:30.514220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ecb824a6-e9a4-4440-a935-c5f54901dac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:30.514671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ecb824a6-e9a4-4440-a935-c5f54901dac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:30.515436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ecb824a6-e9a4-4440-a935-c5f54901dac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:30.515872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ecb824a6-e9a4-4440-a935-c5f54901dac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:30.621241 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ecb824a6-e9a4-4440-a935-c5f54901dac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:30.629158 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ecb824a6-e9a4-4440-a935-c5f54901dac0 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.126009 Jun 02 16:26:30.629722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 909/1604] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:30 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:30.634451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1f7a3488-b2ed-4dc2-b7a6-995caad5fb86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:30.635396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1f7a3488-b2ed-4dc2-b7a6-995caad5fb86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:30.641018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f7a3488-b2ed-4dc2-b7a6-995caad5fb86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:30.641465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f7a3488-b2ed-4dc2-b7a6-995caad5fb86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:30.642273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f7a3488-b2ed-4dc2-b7a6-995caad5fb86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:30.642713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f7a3488-b2ed-4dc2-b7a6-995caad5fb86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:30.672564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1f7a3488-b2ed-4dc2-b7a6-995caad5fb86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Jun 02 16:26:30.673123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 910/1605] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:30.874788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:26:30.874961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:26:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:26:31.646497 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-341f07de-c1a9-4545-add2-0124ab730b21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:31.653944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-341f07de-c1a9-4545-add2-0124ab730b21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:31.653944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-341f07de-c1a9-4545-add2-0124ab730b21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:31.654270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-341f07de-c1a9-4545-add2-0124ab730b21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:31.655039 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-341f07de-c1a9-4545-add2-0124ab730b21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:31.655479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-341f07de-c1a9-4545-add2-0124ab730b21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:31.721165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-341f07de-c1a9-4545-add2-0124ab730b21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:31.729153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-341f07de-c1a9-4545-add2-0124ab730b21 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.086569 Jun 02 16:26:31.729704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 911/1606] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:31 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:31.734310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9a03e2e4-21fb-4685-80d6-9ca9f045ee49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:31.736185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9a03e2e4-21fb-4685-80d6-9ca9f045ee49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:31.740759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a03e2e4-21fb-4685-80d6-9ca9f045ee49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:31.741207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a03e2e4-21fb-4685-80d6-9ca9f045ee49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:31.741961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a03e2e4-21fb-4685-80d6-9ca9f045ee49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:31.742419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a03e2e4-21fb-4685-80d6-9ca9f045ee49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:31.771455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9a03e2e4-21fb-4685-80d6-9ca9f045ee49 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040724 Jun 02 16:26:31.772027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 912/1607] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:31 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:32.369041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:26:32.369211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:26:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:26:32.750881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ac309f8a-4031-4a77-8f78-39d4c07ae44b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:32.751493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ac309f8a-4031-4a77-8f78-39d4c07ae44b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:32.757984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac309f8a-4031-4a77-8f78-39d4c07ae44b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:32.758468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac309f8a-4031-4a77-8f78-39d4c07ae44b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:32.760110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac309f8a-4031-4a77-8f78-39d4c07ae44b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:32.760545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ac309f8a-4031-4a77-8f78-39d4c07ae44b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:32.822602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ac309f8a-4031-4a77-8f78-39d4c07ae44b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:32.829976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ac309f8a-4031-4a77-8f78-39d4c07ae44b tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.083000 Jun 02 16:26:32.830561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 913/1608] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:32 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:32.834989 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7e500ba7-3de0-4155-853a-6accbd0cbf40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:32.835894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7e500ba7-3de0-4155-853a-6accbd0cbf40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:32.841713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e500ba7-3de0-4155-853a-6accbd0cbf40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:32.842224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e500ba7-3de0-4155-853a-6accbd0cbf40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:32.843042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e500ba7-3de0-4155-853a-6accbd0cbf40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:32.843479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e500ba7-3de0-4155-853a-6accbd0cbf40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:32.872528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7e500ba7-3de0-4155-853a-6accbd0cbf40 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040998 Jun 02 16:26:32.873288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 914/1609] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:33.847038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-654a28a0-d0cb-4471-a2d5-eb17cc8eaeb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:33.847750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-654a28a0-d0cb-4471-a2d5-eb17cc8eaeb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:33.854723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-654a28a0-d0cb-4471-a2d5-eb17cc8eaeb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:33.855169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-654a28a0-d0cb-4471-a2d5-eb17cc8eaeb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:33.855924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-654a28a0-d0cb-4471-a2d5-eb17cc8eaeb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:33.856363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-654a28a0-d0cb-4471-a2d5-eb17cc8eaeb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:33.916195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-654a28a0-d0cb-4471-a2d5-eb17cc8eaeb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:33.923549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-654a28a0-d0cb-4471-a2d5-eb17cc8eaeb2 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080634 Jun 02 16:26:33.924096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 915/1610] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:33 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:33.928478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-66c6092c-70a8-4c16-a5cf-f9c6994b0496 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:33.929371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-66c6092c-70a8-4c16-a5cf-f9c6994b0496 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:33.934903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66c6092c-70a8-4c16-a5cf-f9c6994b0496 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:33.935346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66c6092c-70a8-4c16-a5cf-f9c6994b0496 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:33.936095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66c6092c-70a8-4c16-a5cf-f9c6994b0496 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:33.936524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-66c6092c-70a8-4c16-a5cf-f9c6994b0496 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:33.964686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-66c6092c-70a8-4c16-a5cf-f9c6994b0496 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039633 Jun 02 16:26:33.965223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 916/1611] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:34.940396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b876d847-c1ae-4975-b7b1-ccffc2614cfe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:34.941030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b876d847-c1ae-4975-b7b1-ccffc2614cfe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:34.948179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b876d847-c1ae-4975-b7b1-ccffc2614cfe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:34.948636 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b876d847-c1ae-4975-b7b1-ccffc2614cfe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:34.949420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b876d847-c1ae-4975-b7b1-ccffc2614cfe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:34.949862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b876d847-c1ae-4975-b7b1-ccffc2614cfe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:35.011784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b876d847-c1ae-4975-b7b1-ccffc2614cfe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:35.019517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b876d847-c1ae-4975-b7b1-ccffc2614cfe tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.082939 Jun 02 16:26:35.020075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 917/1612] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:34 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:35.024609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bf5dd9c2-1bbd-49cf-97b2-b61645517458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:35.026819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bf5dd9c2-1bbd-49cf-97b2-b61645517458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:35.032409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf5dd9c2-1bbd-49cf-97b2-b61645517458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:35.032866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf5dd9c2-1bbd-49cf-97b2-b61645517458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:35.033646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf5dd9c2-1bbd-49cf-97b2-b61645517458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:35.034099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf5dd9c2-1bbd-49cf-97b2-b61645517458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:35.064677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bf5dd9c2-1bbd-49cf-97b2-b61645517458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043558 Jun 02 16:26:35.065237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 918/1613] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:35 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:36.036941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f6235b50-f411-43bb-8f4a-6f60265e3d6d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:36.037555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f6235b50-f411-43bb-8f4a-6f60265e3d6d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:36.044988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f6235b50-f411-43bb-8f4a-6f60265e3d6d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:36.045443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f6235b50-f411-43bb-8f4a-6f60265e3d6d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:36.046257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f6235b50-f411-43bb-8f4a-6f60265e3d6d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:36.046721 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f6235b50-f411-43bb-8f4a-6f60265e3d6d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:36.110340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f6235b50-f411-43bb-8f4a-6f60265e3d6d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:36.117759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f6235b50-f411-43bb-8f4a-6f60265e3d6d tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084757 Jun 02 16:26:36.118617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 919/1614] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:36 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:36.123090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b71c0657-4e08-47e6-83a3-30b6bc300fb9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:36.123997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b71c0657-4e08-47e6-83a3-30b6bc300fb9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:36.129572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b71c0657-4e08-47e6-83a3-30b6bc300fb9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:36.130027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b71c0657-4e08-47e6-83a3-30b6bc300fb9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:36.130891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b71c0657-4e08-47e6-83a3-30b6bc300fb9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:36.131380 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b71c0657-4e08-47e6-83a3-30b6bc300fb9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:36.161197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b71c0657-4e08-47e6-83a3-30b6bc300fb9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041586 Jun 02 16:26:36.161744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 920/1615] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:36 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:37.135310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-40431643-43d2-45ba-ab32-e3a907604a03 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:37.135953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-40431643-43d2-45ba-ab32-e3a907604a03 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:37.139240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:26:37.142652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40431643-43d2-45ba-ab32-e3a907604a03 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:37.143106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40431643-43d2-45ba-ab32-e3a907604a03 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:37.143881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40431643-43d2-45ba-ab32-e3a907604a03 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:37.144320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-40431643-43d2-45ba-ab32-e3a907604a03 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:37.148242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:26:37.206802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-40431643-43d2-45ba-ab32-e3a907604a03 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:37.215251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-40431643-43d2-45ba-ab32-e3a907604a03 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.084104 Jun 02 16:26:37.215806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 921/1616] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:37 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:37.220552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-01c88f8d-ff32-44a1-a38b-df6a19cb651f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:37.221466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-01c88f8d-ff32-44a1-a38b-df6a19cb651f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:37.227440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01c88f8d-ff32-44a1-a38b-df6a19cb651f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:37.228297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01c88f8d-ff32-44a1-a38b-df6a19cb651f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:37.229069 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01c88f8d-ff32-44a1-a38b-df6a19cb651f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:37.229512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01c88f8d-ff32-44a1-a38b-df6a19cb651f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:37.266498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-01c88f8d-ff32-44a1-a38b-df6a19cb651f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049339 Jun 02 16:26:37.267273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 922/1617] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:37 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:38.233119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1dcde39c-052a-4deb-bde0-d95262cacd71 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:38.233724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1dcde39c-052a-4deb-bde0-d95262cacd71 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:38.240161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1dcde39c-052a-4deb-bde0-d95262cacd71 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:38.240610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1dcde39c-052a-4deb-bde0-d95262cacd71 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:38.241368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1dcde39c-052a-4deb-bde0-d95262cacd71 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:38.241803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1dcde39c-052a-4deb-bde0-d95262cacd71 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:38.301615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1dcde39c-052a-4deb-bde0-d95262cacd71 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:38.309065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1dcde39c-052a-4deb-bde0-d95262cacd71 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.080762 Jun 02 16:26:38.309620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 923/1618] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:38 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:38.314060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e1e7b60a-de92-4e34-8350-3bb2efde6c21 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:38.314983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e1e7b60a-de92-4e34-8350-3bb2efde6c21 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:38.320519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1e7b60a-de92-4e34-8350-3bb2efde6c21 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:38.320968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1e7b60a-de92-4e34-8350-3bb2efde6c21 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:38.321729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1e7b60a-de92-4e34-8350-3bb2efde6c21 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:38.322225 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1e7b60a-de92-4e34-8350-3bb2efde6c21 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:38.351300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e1e7b60a-de92-4e34-8350-3bb2efde6c21 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040681 Jun 02 16:26:38.351851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 924/1619] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:38 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:39.326524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e9fd0ead-79bf-41cc-8478-542ec32a4852 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:39.327198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e9fd0ead-79bf-41cc-8478-542ec32a4852 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:39.333050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9fd0ead-79bf-41cc-8478-542ec32a4852 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:39.333493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9fd0ead-79bf-41cc-8478-542ec32a4852 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:39.334288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9fd0ead-79bf-41cc-8478-542ec32a4852 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:39.334724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e9fd0ead-79bf-41cc-8478-542ec32a4852 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:39.395613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e9fd0ead-79bf-41cc-8478-542ec32a4852 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:39.403516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e9fd0ead-79bf-41cc-8478-542ec32a4852 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081460 Jun 02 16:26:39.404090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 925/1620] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:39 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:39.408539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-56dbbf4b-b1da-4c9e-8777-bc3de657206e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:39.409475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-56dbbf4b-b1da-4c9e-8777-bc3de657206e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:39.415280 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-56dbbf4b-b1da-4c9e-8777-bc3de657206e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:39.415734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-56dbbf4b-b1da-4c9e-8777-bc3de657206e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:39.417602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-56dbbf4b-b1da-4c9e-8777-bc3de657206e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:39.418043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-56dbbf4b-b1da-4c9e-8777-bc3de657206e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:39.447923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-56dbbf4b-b1da-4c9e-8777-bc3de657206e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Jun 02 16:26:39.448415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 926/1621] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:40.421148 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f2d3bd48-5507-4d08-9575-0dddda42186a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:40.421812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f2d3bd48-5507-4d08-9575-0dddda42186a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:40.432099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2d3bd48-5507-4d08-9575-0dddda42186a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:40.432099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2d3bd48-5507-4d08-9575-0dddda42186a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:40.432099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2d3bd48-5507-4d08-9575-0dddda42186a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:40.432099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2d3bd48-5507-4d08-9575-0dddda42186a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:40.493604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f2d3bd48-5507-4d08-9575-0dddda42186a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:40.502063 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f2d3bd48-5507-4d08-9575-0dddda42186a tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.085181 Jun 02 16:26:40.502643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 927/1622] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:40 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:40.507170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5ace762d-80e9-4eb6-9dd1-6ab3f5e442ac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:40.508079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5ace762d-80e9-4eb6-9dd1-6ab3f5e442ac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:40.514799 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ace762d-80e9-4eb6-9dd1-6ab3f5e442ac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:40.515252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ace762d-80e9-4eb6-9dd1-6ab3f5e442ac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:40.516047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ace762d-80e9-4eb6-9dd1-6ab3f5e442ac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:40.516485 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5ace762d-80e9-4eb6-9dd1-6ab3f5e442ac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:40.545969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5ace762d-80e9-4eb6-9dd1-6ab3f5e442ac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Jun 02 16:26:40.546550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 928/1623] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:41.518937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1ef15120-086d-4472-af29-0741a5d4b5b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:41.519590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1ef15120-086d-4472-af29-0741a5d4b5b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:41.526570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1ef15120-086d-4472-af29-0741a5d4b5b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:41.527098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1ef15120-086d-4472-af29-0741a5d4b5b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:41.527856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1ef15120-086d-4472-af29-0741a5d4b5b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:41.528289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1ef15120-086d-4472-af29-0741a5d4b5b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:41.587772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1ef15120-086d-4472-af29-0741a5d4b5b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:26:41.596209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1ef15120-086d-4472-af29-0741a5d4b5b4 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.081250 Jun 02 16:26:41.596762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 929/1624] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:26:41 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:26:41.601694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6b6c6541-dbdf-4d1a-b737-beddce9d7fe1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:41.602387 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6b6c6541-dbdf-4d1a-b737-beddce9d7fe1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:41.608362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6b6c6541-dbdf-4d1a-b737-beddce9d7fe1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:41.618630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6b6c6541-dbdf-4d1a-b737-beddce9d7fe1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:41.618630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6b6c6541-dbdf-4d1a-b737-beddce9d7fe1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:41.618630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6b6c6541-dbdf-4d1a-b737-beddce9d7fe1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:41.641009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6b6c6541-dbdf-4d1a-b737-beddce9d7fe1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043225 Jun 02 16:26:41.641575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 930/1625] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:26:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:26:42.054027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:26:42.054542 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:26:42.060649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:42.061095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:42.061842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:26:42.062302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:26:52.057710 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=20 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:26:52.081022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=62 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:27:42.311705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7802c0d4-dd30-43b8-9baa-1a5c5a3c3e9a) Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Request method failure captured: Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 HTTP/1.1 Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOIzXG0IbLAQ7CtI-2dW_2PANpK8dCZ603QjCOSjp_gxaJBvdTnGIjVojYhaNPazhUPy_6XKZgWaVz2lWWsAKUnhqYvjgkWOtQaI0_6YYma9gBniuhr7uWLDB7BooG4ngqcoc_QWeDddx7Bak-3uDdTtwK9JlQB9qDZQQMy6zP9E-68 Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:27:42.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}] Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 2910f2833ce24b17b248ad9106f19786 Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:27:42.315527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7802c0d4-dd30-43b8-9baa-1a5c5a3c3e9a) Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'server_id': '6d9f21d8-cd12-4d8c-8dc7-765453991dcb', 'id': '82d67b29-e2bc-4537-86f3-ebba9d154c91'} Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 16:27:42.316418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7802c0d4-dd30-43b8-9baa-1a5c5a3c3e9a) Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:27:42.317576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7802c0d4-dd30-43b8-9baa-1a5c5a3c3e9a) Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.319755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7802c0d4-dd30-43b8-9baa-1a5c5a3c3e9a) Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.321066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7802c0d4-dd30-43b8-9baa-1a5c5a3c3e9a) Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7802c0d4-dd30-43b8-9baa-1a5c5a3c3e9a) Jun 02 16:27:42.322551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.324815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7802c0d4-dd30-43b8-9baa-1a5c5a3c3e9a) {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:27:42.324815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-98eb2dce-6ecf-460d-a4b2-6861492b1edc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91" status: 400 len: 269 microversion: 2.1 time: 120.188104 Jun 02 16:27:42.324815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 696/1626] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:25:42 2022] DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 => generated 269 bytes in 120189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:27:42.324815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-16d872a9-deb0-4bd1-857c-401f30adf681 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:42.325383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-16d872a9-deb0-4bd1-857c-401f30adf681 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:42.330600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-16d872a9-deb0-4bd1-857c-401f30adf681 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.331057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-16d872a9-deb0-4bd1-857c-401f30adf681 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.331829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-16d872a9-deb0-4bd1-857c-401f30adf681 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.332266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-16d872a9-deb0-4bd1-857c-401f30adf681 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.361697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lazy-loading 'services' on Instance uuid 6d9f21d8-cd12-4d8c-8dc7-765453991dcb {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:27:42.399993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-16d872a9-deb0-4bd1-857c-401f30adf681 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:27:42.408615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-16d872a9-deb0-4bd1-857c-401f30adf681 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1226 microversion: 2.1 time: 0.091533 Jun 02 16:27:42.409168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 697/1627] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:27:42 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:27:42.413883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f1a8070f-5aef-40d5-8243-f64d2ee0c12e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:42.414824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f1a8070f-5aef-40d5-8243-f64d2ee0c12e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:42.420952 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1a8070f-5aef-40d5-8243-f64d2ee0c12e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.421402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1a8070f-5aef-40d5-8243-f64d2ee0c12e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.422207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1a8070f-5aef-40d5-8243-f64d2ee0c12e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.422647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1a8070f-5aef-40d5-8243-f64d2ee0c12e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.431369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f622b93-8271-448b-be41-80b34d6d4003) Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Request method failure captured: Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 HTTP/1.1 Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOIzXG0IbLAQ7CtI-2dW_2PANpK8dCZ603QjCOSjp_gxaJBvdTnGIjVojYhaNPazhUPy_6XKZgWaVz2lWWsAKUnhqYvjgkWOtQaI0_6YYma9gBniuhr7uWLDB7BooG4ngqcoc_QWeDddx7Bak-3uDdTtwK9JlQB9qDZQQMy6zP9E-68 Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:27:42.434381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}] Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 2910f2833ce24b17b248ad9106f19786 Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:27:42.435941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f622b93-8271-448b-be41-80b34d6d4003) Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'server_id': '6d9f21d8-cd12-4d8c-8dc7-765453991dcb', 'id': '82d67b29-e2bc-4537-86f3-ebba9d154c91'} Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 16:27:42.436615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f622b93-8271-448b-be41-80b34d6d4003) Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:27:42.437687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f622b93-8271-448b-be41-80b34d6d4003) Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.438906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f622b93-8271-448b-be41-80b34d6d4003) Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.439928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f622b93-8271-448b-be41-80b34d6d4003) Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f622b93-8271-448b-be41-80b34d6d4003) Jun 02 16:27:42.441323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.443547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f622b93-8271-448b-be41-80b34d6d4003) {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:27:42.443547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0c71345b-2dfa-49df-938a-de006fc3fc1c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91" status: 400 len: 269 microversion: 2.1 time: 60.449438 Jun 02 16:27:42.443547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 931/1628] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:26:41 2022] DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 => generated 269 bytes in 60451 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 02 16:27:42.444677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:42.445168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:42.451291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.451738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.452495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.452707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f1a8070f-5aef-40d5-8243-f64d2ee0c12e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042493 Jun 02 16:27:42.452932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.458104 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 698/1629] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:42.461081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:42.461584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:42.468726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.469188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.469960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.470463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.484646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] HTTP exception thrown: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Request method failure captured: Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 HTTP/1.1 Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOBfxS4cclfKx3-RndKo8Dh-CNumTLJ_9ppQhQQxKyMPB4EEBU5GFxYA9-LhBrKjDNTyWY87gQZT1pZartY-1sBtFZIfC7qCMEO9Vkk6hprpWxRiJCu0PbwNFMbxNPkdwvsf8s6P7LrQQqRis9Yox-jWNZMH13qPm6c5jIeo1Wfiw4g Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:27:42.486382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}] Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 95108cdd8e134be3823d5024f7037b3e Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.488015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '942de225-4aff-4a9e-85f0-634ab0ac44e3'} Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:27:42.488782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.490347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.492189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Returning 404 to user: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:27:42.492189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1df5d11c-3d75-4418-b88f-166a5f939612 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "DELETE /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 404 len: 111 microversion: 2.20 time: 0.030429 Jun 02 16:27:42.492189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 699/1630] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jun 2 16:27:42 2022] DELETE /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:27:42.496004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:42.496760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: 942de225-4aff-4a9e-85f0-634ab0ac44e3] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:42.502518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.502968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.503731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:42.504167 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:42.519072 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] HTTP exception thrown: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Request method failure captured: Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 HTTP/1.1 Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOBfxS4cclfKx3-RndKo8Dh-CNumTLJ_9ppQhQQxKyMPB4EEBU5GFxYA9-LhBrKjDNTyWY87gQZT1pZartY-1sBtFZIfC7qCMEO9Vkk6hprpWxRiJCu0PbwNFMbxNPkdwvsf8s6P7LrQQqRis9Yox-jWNZMH13qPm6c5jIeo1Wfiw4g Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:27:42.520610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}] Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 95108cdd8e134be3823d5024f7037b3e Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.522319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '942de225-4aff-4a9e-85f0-634ab0ac44e3'} Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:27:42.523878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. Jun 02 16:27:42.525818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.527907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Returning 404 to user: Instance 942de225-4aff-4a9e-85f0-634ab0ac44e3 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:27:42.527907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f1bfac17-d747-46d2-aabf-b90586a614c9 tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3" status: 404 len: 111 microversion: 2.20 time: 0.029804 Jun 02 16:27:42.527907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 700/1631] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:27:42 2022] GET /compute/v2.1/servers/942de225-4aff-4a9e-85f0-634ab0ac44e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:27:42.538677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lazy-loading 'services' on Instance uuid 6d9f21d8-cd12-4d8c-8dc7-765453991dcb {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:27:42.744275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2919d347-daa4-4e81-b802-25e6b94f4f23) Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Request method failure captured: Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 HTTP/1.1 Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOIzXG0IbLAQ7CtI-2dW_2PANpK8dCZ603QjCOSjp_gxaJBvdTnGIjVojYhaNPazhUPy_6XKZgWaVz2lWWsAKUnhqYvjgkWOtQaI0_6YYma9gBniuhr7uWLDB7BooG4ngqcoc_QWeDddx7Bak-3uDdTtwK9JlQB9qDZQQMy6zP9E-68 Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:27:42.746924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}] Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 2910f2833ce24b17b248ad9106f19786 Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:27:42.748598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2919d347-daa4-4e81-b802-25e6b94f4f23) Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'server_id': '6d9f21d8-cd12-4d8c-8dc7-765453991dcb', 'id': '82d67b29-e2bc-4537-86f3-ebba9d154c91'} Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 16:27:42.750425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2919d347-daa4-4e81-b802-25e6b94f4f23) Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 16:27:42.751934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2919d347-daa4-4e81-b802-25e6b94f4f23) Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.753359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2919d347-daa4-4e81-b802-25e6b94f4f23) Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.754742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2919d347-daa4-4e81-b802-25e6b94f4f23) Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2919d347-daa4-4e81-b802-25e6b94f4f23) Jun 02 16:27:42.756464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:27:42.759905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2919d347-daa4-4e81-b802-25e6b94f4f23) {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:27:42.759905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dcf1efd5-a735-4eab-95c8-40775fee4e00 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91" status: 400 len: 269 microversion: 2.1 time: 0.309745 Jun 02 16:27:42.759905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 932/1632] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:27:42 2022] DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb/os-volume_attachments/82d67b29-e2bc-4537-86f3-ebba9d154c91 => generated 269 bytes in 319 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:27:43.425825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:43.426463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:43.433047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:43.433520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:43.434311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:43.434750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:43.464928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fd2a56ea-80a2-4bab-b2ea-fcc184e7562f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:43.465786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:43.466040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fd2a56ea-80a2-4bab-b2ea-fcc184e7562f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:43.466268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:43.466714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lazy-loading 'fault' on Instance uuid 63dfa5a1-a050-48bc-a951-56b9093f383e {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:27:43.472918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fd2a56ea-80a2-4bab-b2ea-fcc184e7562f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:43.473372 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fd2a56ea-80a2-4bab-b2ea-fcc184e7562f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:43.474167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fd2a56ea-80a2-4bab-b2ea-fcc184e7562f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:43.474611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fd2a56ea-80a2-4bab-b2ea-fcc184e7562f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:43.503504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fd2a56ea-80a2-4bab-b2ea-fcc184e7562f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043132 Jun 02 16:27:43.504055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 933/1633] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:43 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:27:43.508371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d2ef2aa9b8c46cfb198bd18a5944a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460ea33e74e8480c8b70c8123e81e4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:27:43.516407 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3633d6b5-986f-43ce-a85d-9c32e6ca3a35 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 200 len: 1231 microversion: 2.1 time: 0.094389 Jun 02 16:27:43.516963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 701/1634] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:27:43 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:27:44.515211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-826ff3f3-dac7-4204-a099-752d7df7ef86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:44.516051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-826ff3f3-dac7-4204-a099-752d7df7ef86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:44.522500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-826ff3f3-dac7-4204-a099-752d7df7ef86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:44.522951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-826ff3f3-dac7-4204-a099-752d7df7ef86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:44.523709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-826ff3f3-dac7-4204-a099-752d7df7ef86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:44.524149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-826ff3f3-dac7-4204-a099-752d7df7ef86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:44.532569 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:44.533299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] [instance: 63dfa5a1-a050-48bc-a951-56b9093f383e] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:44.539908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:44.540357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:44.541123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:44.541559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:44.555326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] HTTP exception thrown: Instance 63dfa5a1-a050-48bc-a951-56b9093f383e could not be found. Jun 02 16:27:44.555525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-826ff3f3-dac7-4204-a099-752d7df7ef86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Jun 02 16:27:44.555936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 934/1635] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:44 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Request method failure captured: Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e HTTP/1.1 Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOGpyRKVXVh8KrlYLyCN5lIYw-rJ1nunSSAzDiS_MBQcxUaynyZQwu3OJHfLSurtujZHdnJllWI2VfiG1dus9dzhLAKVnEaZZUuSByNN6bpBXWhxWZX_uAQPu1kHEpYXC-g2jtMmaSyJnpadaUOym8kumJl_CS_u1FZ-7610Q8jXAi0 Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 460ea33e74e8480c8b70c8123e81e4c4 Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-TestVolumeBootPattern-307656481 Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:27:44.556852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_460ea33e74e8480c8b70c8123e81e4c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/460ea33e74e8480c8b70c8123e81e4c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/460ea33e74e8480c8b70c8123e81e4c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/460ea33e74e8480c8b70c8123e81e4c4"}]}] Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-TestVolumeBootPattern-307656481 Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 460ea33e74e8480c8b70c8123e81e4c4 Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-TestVolumeBootPattern-307656481 Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-TestVolumeBootPattern-307656481-project Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 5d2ef2aa9b8c46cfb198bd18a5944a85 Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-TestVolumeBootPattern-307656481-project Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 63dfa5a1-a050-48bc-a951-56b9093f383e could not be found. Jun 02 16:27:44.559084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '63dfa5a1-a050-48bc-a951-56b9093f383e'} Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63dfa5a1-a050-48bc-a951-56b9093f383e could not be found. Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:27:44.560034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63dfa5a1-a050-48bc-a951-56b9093f383e could not be found. Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63dfa5a1-a050-48bc-a951-56b9093f383e could not be found. Jun 02 16:27:44.561503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:27:44.562860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Returning 404 to user: Instance 63dfa5a1-a050-48bc-a951-56b9093f383e could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:27:44.562860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4dcdb635-d4d6-463c-a133-3f31a6db0816 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e" status: 404 len: 111 microversion: 2.1 time: 0.030247 Jun 02 16:27:44.562860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 702/1636] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:27:44 2022] GET /compute/v2.1/servers/63dfa5a1-a050-48bc-a951-56b9093f383e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 16:27:45.567704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-881c6e41-4a8c-4efc-9a52-0006d08b2c8e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:45.568578 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-881c6e41-4a8c-4efc-9a52-0006d08b2c8e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:45.575936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-881c6e41-4a8c-4efc-9a52-0006d08b2c8e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:45.576388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-881c6e41-4a8c-4efc-9a52-0006d08b2c8e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:45.577157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-881c6e41-4a8c-4efc-9a52-0006d08b2c8e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:45.577596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-881c6e41-4a8c-4efc-9a52-0006d08b2c8e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:45.606874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-881c6e41-4a8c-4efc-9a52-0006d08b2c8e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Jun 02 16:27:45.607433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 935/1637] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:46.618699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cd7df01b-59ca-40af-a1c5-8ecb637bf9d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:46.619542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cd7df01b-59ca-40af-a1c5-8ecb637bf9d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:46.625676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd7df01b-59ca-40af-a1c5-8ecb637bf9d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:46.626160 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd7df01b-59ca-40af-a1c5-8ecb637bf9d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:46.626920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd7df01b-59ca-40af-a1c5-8ecb637bf9d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:46.627356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd7df01b-59ca-40af-a1c5-8ecb637bf9d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:46.656937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cd7df01b-59ca-40af-a1c5-8ecb637bf9d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 Jun 02 16:27:46.657475 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 703/1638] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:47.669278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bc429509-57ed-42e2-8790-1833255efcc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:47.670223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bc429509-57ed-42e2-8790-1833255efcc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:47.676847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc429509-57ed-42e2-8790-1833255efcc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:47.677300 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc429509-57ed-42e2-8790-1833255efcc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:47.678062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc429509-57ed-42e2-8790-1833255efcc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:47.678521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bc429509-57ed-42e2-8790-1833255efcc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:47.708001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bc429509-57ed-42e2-8790-1833255efcc2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043395 Jun 02 16:27:47.708564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 936/1639] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:47 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:48.720138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1a368253-ea61-4056-b4f3-60fa9a76e796 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:48.721048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1a368253-ea61-4056-b4f3-60fa9a76e796 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:48.727436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1a368253-ea61-4056-b4f3-60fa9a76e796 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:48.727880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1a368253-ea61-4056-b4f3-60fa9a76e796 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:48.728634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1a368253-ea61-4056-b4f3-60fa9a76e796 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:48.729068 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1a368253-ea61-4056-b4f3-60fa9a76e796 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:48.758162 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1a368253-ea61-4056-b4f3-60fa9a76e796 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042218 Jun 02 16:27:48.758711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 704/1640] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:48 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:49.769691 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2be61ac7-f0e4-402a-a5b2-017dd05021a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:49.770558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2be61ac7-f0e4-402a-a5b2-017dd05021a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:49.777261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2be61ac7-f0e4-402a-a5b2-017dd05021a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:49.777716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2be61ac7-f0e4-402a-a5b2-017dd05021a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:49.778530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2be61ac7-f0e4-402a-a5b2-017dd05021a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:49.778971 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2be61ac7-f0e4-402a-a5b2-017dd05021a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:49.808551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2be61ac7-f0e4-402a-a5b2-017dd05021a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042929 Jun 02 16:27:49.809084 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 937/1641] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:50.820072 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a3e1e86e-4e64-4ace-9cd2-b1863761919a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:50.820987 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a3e1e86e-4e64-4ace-9cd2-b1863761919a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:50.827505 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a3e1e86e-4e64-4ace-9cd2-b1863761919a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:50.827946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a3e1e86e-4e64-4ace-9cd2-b1863761919a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:50.828702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a3e1e86e-4e64-4ace-9cd2-b1863761919a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:50.829136 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a3e1e86e-4e64-4ace-9cd2-b1863761919a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:50.858419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a3e1e86e-4e64-4ace-9cd2-b1863761919a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042254 Jun 02 16:27:50.858964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 705/1642] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:51.869201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b85e61ed-a68f-4ea7-afc7-807906946fd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:51.870777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b85e61ed-a68f-4ea7-afc7-807906946fd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:51.877748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b85e61ed-a68f-4ea7-afc7-807906946fd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:51.878236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b85e61ed-a68f-4ea7-afc7-807906946fd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:51.879004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b85e61ed-a68f-4ea7-afc7-807906946fd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:51.879474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b85e61ed-a68f-4ea7-afc7-807906946fd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:51.908564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b85e61ed-a68f-4ea7-afc7-807906946fd0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Jun 02 16:27:51.909107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 938/1643] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:52.920751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5f8cdbc0-f007-4f69-8eee-61f157180040 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:52.921681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5f8cdbc0-f007-4f69-8eee-61f157180040 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:52.928257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f8cdbc0-f007-4f69-8eee-61f157180040 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:52.928714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f8cdbc0-f007-4f69-8eee-61f157180040 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:52.929483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f8cdbc0-f007-4f69-8eee-61f157180040 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:52.929923 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5f8cdbc0-f007-4f69-8eee-61f157180040 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:52.960809 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5f8cdbc0-f007-4f69-8eee-61f157180040 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Jun 02 16:27:52.961368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 706/1644] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:52 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:27:53.972709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-855e4233-8f44-4b2a-b9bf-718872f95d3c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:53.973633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-855e4233-8f44-4b2a-b9bf-718872f95d3c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:53.980396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-855e4233-8f44-4b2a-b9bf-718872f95d3c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:53.980848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-855e4233-8f44-4b2a-b9bf-718872f95d3c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:53.981611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-855e4233-8f44-4b2a-b9bf-718872f95d3c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:53.982054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-855e4233-8f44-4b2a-b9bf-718872f95d3c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:54.010658 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-855e4233-8f44-4b2a-b9bf-718872f95d3c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041634 Jun 02 16:27:54.011291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 939/1645] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:53 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:55.022317 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-619ee3f5-6852-4047-ab20-ff061f8acc33 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:55.023157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-619ee3f5-6852-4047-ab20-ff061f8acc33 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:55.029712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-619ee3f5-6852-4047-ab20-ff061f8acc33 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:55.030189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-619ee3f5-6852-4047-ab20-ff061f8acc33 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:55.031231 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-619ee3f5-6852-4047-ab20-ff061f8acc33 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:55.031676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-619ee3f5-6852-4047-ab20-ff061f8acc33 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:55.063414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-619ee3f5-6852-4047-ab20-ff061f8acc33 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Jun 02 16:27:55.063966 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 707/1646] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:56.075548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e53a7b45-65e0-4b09-b615-8361283e783d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:56.076385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e53a7b45-65e0-4b09-b615-8361283e783d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:56.082878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e53a7b45-65e0-4b09-b615-8361283e783d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:56.083332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e53a7b45-65e0-4b09-b615-8361283e783d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:56.084126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e53a7b45-65e0-4b09-b615-8361283e783d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:56.084563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e53a7b45-65e0-4b09-b615-8361283e783d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:56.114490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e53a7b45-65e0-4b09-b615-8361283e783d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043029 Jun 02 16:27:56.115037 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 940/1647] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:57.126812 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-dea35c62-f72e-4e45-a53b-5f57984bf7dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:57.127651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-dea35c62-f72e-4e45-a53b-5f57984bf7dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:57.134184 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dea35c62-f72e-4e45-a53b-5f57984bf7dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:57.134644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dea35c62-f72e-4e45-a53b-5f57984bf7dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:57.135960 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dea35c62-f72e-4e45-a53b-5f57984bf7dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:57.136403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dea35c62-f72e-4e45-a53b-5f57984bf7dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:57.164663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-dea35c62-f72e-4e45-a53b-5f57984bf7dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041950 Jun 02 16:27:57.165209 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 708/1648] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:57 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:58.176052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1f994285-5a53-44fc-8739-c8336d32147b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:58.176964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1f994285-5a53-44fc-8739-c8336d32147b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:58.184140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f994285-5a53-44fc-8739-c8336d32147b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:58.184593 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f994285-5a53-44fc-8739-c8336d32147b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:58.185368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f994285-5a53-44fc-8739-c8336d32147b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:58.185810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1f994285-5a53-44fc-8739-c8336d32147b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:58.215497 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1f994285-5a53-44fc-8739-c8336d32147b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Jun 02 16:27:58.216055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 941/1649] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:58 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:27:59.227274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d5545f23-ade2-4519-8764-dca4fae2ece6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:27:59.228220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d5545f23-ade2-4519-8764-dca4fae2ece6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:27:59.234691 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5545f23-ade2-4519-8764-dca4fae2ece6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:59.235131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5545f23-ade2-4519-8764-dca4fae2ece6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:59.235885 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5545f23-ade2-4519-8764-dca4fae2ece6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:27:59.236313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5545f23-ade2-4519-8764-dca4fae2ece6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:27:59.265199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d5545f23-ade2-4519-8764-dca4fae2ece6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041828 Jun 02 16:27:59.265741 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 709/1650] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:27:59 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:28:00.278020 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-60d6a948-5403-437c-8ece-77e77895ad41 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:00.278973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-60d6a948-5403-437c-8ece-77e77895ad41 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:00.285503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-60d6a948-5403-437c-8ece-77e77895ad41 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:00.285959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-60d6a948-5403-437c-8ece-77e77895ad41 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:00.286764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-60d6a948-5403-437c-8ece-77e77895ad41 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:00.287207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-60d6a948-5403-437c-8ece-77e77895ad41 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:00.319181 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-60d6a948-5403-437c-8ece-77e77895ad41 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046345 Jun 02 16:28:00.319741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 942/1651] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:01.331531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d716a46c-0e65-43ee-9856-4970fc50e19c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:01.332446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d716a46c-0e65-43ee-9856-4970fc50e19c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:01.339430 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d716a46c-0e65-43ee-9856-4970fc50e19c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:01.339883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d716a46c-0e65-43ee-9856-4970fc50e19c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:01.340661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d716a46c-0e65-43ee-9856-4970fc50e19c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:01.341105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d716a46c-0e65-43ee-9856-4970fc50e19c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:01.372971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d716a46c-0e65-43ee-9856-4970fc50e19c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045345 Jun 02 16:28:01.373535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 710/1652] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:01 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:02.384924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-248fccbb-673e-4870-8d6d-cb76f1033405 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:02.386268 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-248fccbb-673e-4870-8d6d-cb76f1033405 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:02.392717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-248fccbb-673e-4870-8d6d-cb76f1033405 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:02.393172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-248fccbb-673e-4870-8d6d-cb76f1033405 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:02.393939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-248fccbb-673e-4870-8d6d-cb76f1033405 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:02.394416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-248fccbb-673e-4870-8d6d-cb76f1033405 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:02.424208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-248fccbb-673e-4870-8d6d-cb76f1033405 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Jun 02 16:28:02.424673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 943/1653] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:03.435840 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c803d747-2789-4a94-b9c7-eed694963bf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:03.436661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c803d747-2789-4a94-b9c7-eed694963bf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:03.443769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c803d747-2789-4a94-b9c7-eed694963bf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:03.444212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c803d747-2789-4a94-b9c7-eed694963bf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:03.444978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c803d747-2789-4a94-b9c7-eed694963bf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:03.445410 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c803d747-2789-4a94-b9c7-eed694963bf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:03.451129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=75 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:03.478472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c803d747-2789-4a94-b9c7-eed694963bf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 Jun 02 16:28:03.479699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 711/1654] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:03 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:04.490734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0f5ae603-8c6d-4cf8-a0df-f7139ea918e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:04.491720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0f5ae603-8c6d-4cf8-a0df-f7139ea918e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:04.498909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f5ae603-8c6d-4cf8-a0df-f7139ea918e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:04.499361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f5ae603-8c6d-4cf8-a0df-f7139ea918e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:04.500138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f5ae603-8c6d-4cf8-a0df-f7139ea918e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:04.500582 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f5ae603-8c6d-4cf8-a0df-f7139ea918e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:04.529016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0f5ae603-8c6d-4cf8-a0df-f7139ea918e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042333 Jun 02 16:28:04.529560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 944/1655] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:04 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:05.540074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bf92bcd7-720c-4093-b85a-5328d7351b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:05.541023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bf92bcd7-720c-4093-b85a-5328d7351b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:05.547930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf92bcd7-720c-4093-b85a-5328d7351b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:05.548372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf92bcd7-720c-4093-b85a-5328d7351b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:05.549130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf92bcd7-720c-4093-b85a-5328d7351b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:05.549564 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf92bcd7-720c-4093-b85a-5328d7351b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:05.578651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bf92bcd7-720c-4093-b85a-5328d7351b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042518 Jun 02 16:28:05.579198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 712/1656] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:06.590506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-35b85044-99ea-4cd1-a140-0fdda9ee48dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:06.591752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-35b85044-99ea-4cd1-a140-0fdda9ee48dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:06.599027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-35b85044-99ea-4cd1-a140-0fdda9ee48dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:06.599472 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-35b85044-99ea-4cd1-a140-0fdda9ee48dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:06.600297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-35b85044-99ea-4cd1-a140-0fdda9ee48dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:06.600744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-35b85044-99ea-4cd1-a140-0fdda9ee48dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:06.631265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-35b85044-99ea-4cd1-a140-0fdda9ee48dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045441 Jun 02 16:28:06.631831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 945/1657] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:07.643329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-97f6d5df-92fa-4c42-af3f-16c2cce2a322 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:07.644256 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-97f6d5df-92fa-4c42-af3f-16c2cce2a322 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:07.651784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-97f6d5df-92fa-4c42-af3f-16c2cce2a322 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:07.652238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-97f6d5df-92fa-4c42-af3f-16c2cce2a322 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:07.653015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-97f6d5df-92fa-4c42-af3f-16c2cce2a322 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:07.653455 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-97f6d5df-92fa-4c42-af3f-16c2cce2a322 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:07.682677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-97f6d5df-92fa-4c42-af3f-16c2cce2a322 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Jun 02 16:28:07.683237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 713/1658] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:08.694423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-24901a9a-5683-4d0c-8f6f-0c7f0f4670b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:08.695346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-24901a9a-5683-4d0c-8f6f-0c7f0f4670b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:08.701950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24901a9a-5683-4d0c-8f6f-0c7f0f4670b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:08.702431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24901a9a-5683-4d0c-8f6f-0c7f0f4670b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:08.703206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24901a9a-5683-4d0c-8f6f-0c7f0f4670b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:08.703646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24901a9a-5683-4d0c-8f6f-0c7f0f4670b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:08.733960 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-24901a9a-5683-4d0c-8f6f-0c7f0f4670b4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Jun 02 16:28:08.734552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 946/1659] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:08 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:09.745917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3e498251-f8cf-4c5e-88e4-a425d9a58c92 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:09.746935 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3e498251-f8cf-4c5e-88e4-a425d9a58c92 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:09.753418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e498251-f8cf-4c5e-88e4-a425d9a58c92 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:09.753870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e498251-f8cf-4c5e-88e4-a425d9a58c92 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:09.754660 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e498251-f8cf-4c5e-88e4-a425d9a58c92 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:09.755101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e498251-f8cf-4c5e-88e4-a425d9a58c92 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:09.785225 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3e498251-f8cf-4c5e-88e4-a425d9a58c92 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Jun 02 16:28:09.785787 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 714/1660] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:10.796926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b8eb5d53-edfb-4401-9056-71bcc493b48d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:10.797853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b8eb5d53-edfb-4401-9056-71bcc493b48d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:10.804070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8eb5d53-edfb-4401-9056-71bcc493b48d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:10.804522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8eb5d53-edfb-4401-9056-71bcc493b48d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:10.805285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8eb5d53-edfb-4401-9056-71bcc493b48d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:10.805721 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8eb5d53-edfb-4401-9056-71bcc493b48d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:10.822985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:10.835075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b8eb5d53-edfb-4401-9056-71bcc493b48d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042144 Jun 02 16:28:10.840054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 947/1661] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:10 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:11.852112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-97714ee7-be72-4fc9-8736-de6506b9fe70 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:11.853747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-97714ee7-be72-4fc9-8736-de6506b9fe70 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:11.860277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-97714ee7-be72-4fc9-8736-de6506b9fe70 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:11.860664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-97714ee7-be72-4fc9-8736-de6506b9fe70 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:11.861418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-97714ee7-be72-4fc9-8736-de6506b9fe70 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:11.861854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-97714ee7-be72-4fc9-8736-de6506b9fe70 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:11.889553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-97714ee7-be72-4fc9-8736-de6506b9fe70 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041380 Jun 02 16:28:11.890119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 715/1662] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:11 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:12.901490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-94c74be4-e513-4297-affa-1c94d8f2abaa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:12.902445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-94c74be4-e513-4297-affa-1c94d8f2abaa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:12.904675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=33 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:12.909341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-94c74be4-e513-4297-affa-1c94d8f2abaa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:12.909788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-94c74be4-e513-4297-affa-1c94d8f2abaa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:12.910573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-94c74be4-e513-4297-affa-1c94d8f2abaa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:12.911004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-94c74be4-e513-4297-affa-1c94d8f2abaa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:12.940278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-94c74be4-e513-4297-affa-1c94d8f2abaa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 Jun 02 16:28:12.940812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 948/1663] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:13.952447 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e94f3ecd-e1d5-4005-92f3-4f07a7c0b7eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:13.953530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e94f3ecd-e1d5-4005-92f3-4f07a7c0b7eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:13.955811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=41 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:13.960534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e94f3ecd-e1d5-4005-92f3-4f07a7c0b7eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:13.960976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e94f3ecd-e1d5-4005-92f3-4f07a7c0b7eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:13.961729 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e94f3ecd-e1d5-4005-92f3-4f07a7c0b7eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:13.962194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e94f3ecd-e1d5-4005-92f3-4f07a7c0b7eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:13.990847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e94f3ecd-e1d5-4005-92f3-4f07a7c0b7eb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Jun 02 16:28:13.991390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 716/1664] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:13 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:15.003202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4b2ef776-7223-4695-8595-eb57504bf2b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:15.004164 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4b2ef776-7223-4695-8595-eb57504bf2b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:15.011256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4b2ef776-7223-4695-8595-eb57504bf2b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:15.011703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4b2ef776-7223-4695-8595-eb57504bf2b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:15.012473 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4b2ef776-7223-4695-8595-eb57504bf2b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:15.012908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4b2ef776-7223-4695-8595-eb57504bf2b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:15.041848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4b2ef776-7223-4695-8595-eb57504bf2b5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042624 Jun 02 16:28:15.042357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 949/1665] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:16.053639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-863c93b2-b503-4986-b4ce-aa84f2cc187c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:16.054611 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-863c93b2-b503-4986-b4ce-aa84f2cc187c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:16.061878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-863c93b2-b503-4986-b4ce-aa84f2cc187c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:16.062357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-863c93b2-b503-4986-b4ce-aa84f2cc187c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:16.063113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-863c93b2-b503-4986-b4ce-aa84f2cc187c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:16.063545 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-863c93b2-b503-4986-b4ce-aa84f2cc187c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:16.091967 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-863c93b2-b503-4986-b4ce-aa84f2cc187c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042665 Jun 02 16:28:16.092515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 717/1666] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:17.103866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7a4f4a38-eefc-4085-ad2a-1c3e9aec9251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:17.104777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7a4f4a38-eefc-4085-ad2a-1c3e9aec9251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:17.111214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a4f4a38-eefc-4085-ad2a-1c3e9aec9251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:17.111675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a4f4a38-eefc-4085-ad2a-1c3e9aec9251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:17.112427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a4f4a38-eefc-4085-ad2a-1c3e9aec9251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:17.112857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a4f4a38-eefc-4085-ad2a-1c3e9aec9251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:17.141693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7a4f4a38-eefc-4085-ad2a-1c3e9aec9251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Jun 02 16:28:17.142259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 950/1667] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:18.155555 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f6d55fa8-2db2-4061-a330-50360744c9ec tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:18.156575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f6d55fa8-2db2-4061-a330-50360744c9ec tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:18.162667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6d55fa8-2db2-4061-a330-50360744c9ec tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:18.163121 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6d55fa8-2db2-4061-a330-50360744c9ec tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:18.163890 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6d55fa8-2db2-4061-a330-50360744c9ec tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:18.164546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6d55fa8-2db2-4061-a330-50360744c9ec tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:18.194493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f6d55fa8-2db2-4061-a330-50360744c9ec tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Jun 02 16:28:18.195140 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 718/1668] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:19.206810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dcaa8542-16e5-467f-b71a-05c6b870a2bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:19.207739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dcaa8542-16e5-467f-b71a-05c6b870a2bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:19.214772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcaa8542-16e5-467f-b71a-05c6b870a2bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:19.215114 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcaa8542-16e5-467f-b71a-05c6b870a2bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:19.215888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcaa8542-16e5-467f-b71a-05c6b870a2bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:19.216330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dcaa8542-16e5-467f-b71a-05c6b870a2bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:19.246520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dcaa8542-16e5-467f-b71a-05c6b870a2bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Jun 02 16:28:19.247073 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 951/1669] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:19 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:20.084603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:28:20.085131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:28:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:28:20.257234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-af3a593c-d718-4f95-8620-117b992d2cbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:20.258218 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-af3a593c-d718-4f95-8620-117b992d2cbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:20.265137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-af3a593c-d718-4f95-8620-117b992d2cbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:20.265583 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-af3a593c-d718-4f95-8620-117b992d2cbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:20.266421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-af3a593c-d718-4f95-8620-117b992d2cbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:20.266852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-af3a593c-d718-4f95-8620-117b992d2cbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:20.296716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-af3a593c-d718-4f95-8620-117b992d2cbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043396 Jun 02 16:28:20.297255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 719/1670] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:21.309420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7866f001-cf8a-4c72-ad5a-fcf1890e59ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:21.310374 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7866f001-cf8a-4c72-ad5a-fcf1890e59ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:21.316876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7866f001-cf8a-4c72-ad5a-fcf1890e59ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:21.317333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7866f001-cf8a-4c72-ad5a-fcf1890e59ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:21.318126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7866f001-cf8a-4c72-ad5a-fcf1890e59ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:21.318573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7866f001-cf8a-4c72-ad5a-fcf1890e59ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:21.348461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7866f001-cf8a-4c72-ad5a-fcf1890e59ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Jun 02 16:28:21.349034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 952/1671] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:22.360032 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ed506886-8353-483d-ae42-9afc88123e20 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:22.360982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ed506886-8353-483d-ae42-9afc88123e20 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:22.367539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ed506886-8353-483d-ae42-9afc88123e20 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:22.368513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ed506886-8353-483d-ae42-9afc88123e20 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:22.369631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ed506886-8353-483d-ae42-9afc88123e20 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:22.370094 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ed506886-8353-483d-ae42-9afc88123e20 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:22.398989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ed506886-8353-483d-ae42-9afc88123e20 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Jun 02 16:28:22.399768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 720/1672] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:23.410010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6afce4e8-363e-4e69-9a50-fada0923e3a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:23.410965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6afce4e8-363e-4e69-9a50-fada0923e3a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:23.418026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6afce4e8-363e-4e69-9a50-fada0923e3a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:23.418512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6afce4e8-363e-4e69-9a50-fada0923e3a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:23.419280 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6afce4e8-363e-4e69-9a50-fada0923e3a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:23.419723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6afce4e8-363e-4e69-9a50-fada0923e3a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:23.449409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6afce4e8-363e-4e69-9a50-fada0923e3a4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Jun 02 16:28:23.449881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 953/1673] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:24.461000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a12a5731-125b-47e6-b054-c610592f3965 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:24.462605 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a12a5731-125b-47e6-b054-c610592f3965 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:24.469655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a12a5731-125b-47e6-b054-c610592f3965 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:24.470161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a12a5731-125b-47e6-b054-c610592f3965 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:24.470929 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a12a5731-125b-47e6-b054-c610592f3965 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:24.471358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a12a5731-125b-47e6-b054-c610592f3965 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:24.501936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a12a5731-125b-47e6-b054-c610592f3965 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Jun 02 16:28:24.502519 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 721/1674] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:25.513279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5477872d-8549-4be0-ba64-5ece91651ffd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:25.514226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5477872d-8549-4be0-ba64-5ece91651ffd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:25.520735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5477872d-8549-4be0-ba64-5ece91651ffd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:25.521184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5477872d-8549-4be0-ba64-5ece91651ffd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:25.521978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5477872d-8549-4be0-ba64-5ece91651ffd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:25.522444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5477872d-8549-4be0-ba64-5ece91651ffd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:25.551483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5477872d-8549-4be0-ba64-5ece91651ffd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Jun 02 16:28:25.552021 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 954/1675] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:25 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:26.163021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:28:26.163506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:28:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:28:26.481260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:28:26.481498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:28:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:28:26.562762 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7be44ecc-5afa-40f4-8a19-3e1bd39b6061 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:26.563684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7be44ecc-5afa-40f4-8a19-3e1bd39b6061 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:26.573008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7be44ecc-5afa-40f4-8a19-3e1bd39b6061 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:26.573462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7be44ecc-5afa-40f4-8a19-3e1bd39b6061 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:26.574260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7be44ecc-5afa-40f4-8a19-3e1bd39b6061 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:26.574705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7be44ecc-5afa-40f4-8a19-3e1bd39b6061 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:26.603529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7be44ecc-5afa-40f4-8a19-3e1bd39b6061 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Jun 02 16:28:26.604077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 722/1676] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:27.614365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0c869b41-19f8-4a98-a600-df023b6f4522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:27.617498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0c869b41-19f8-4a98-a600-df023b6f4522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:27.621923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c869b41-19f8-4a98-a600-df023b6f4522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:27.622406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c869b41-19f8-4a98-a600-df023b6f4522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:27.623172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c869b41-19f8-4a98-a600-df023b6f4522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:27.623639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c869b41-19f8-4a98-a600-df023b6f4522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:27.652713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0c869b41-19f8-4a98-a600-df023b6f4522 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Jun 02 16:28:27.653260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 955/1677] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:28.664380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-17941a6b-174b-4bf9-a79a-0ddfd4941356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:28.666041 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-17941a6b-174b-4bf9-a79a-0ddfd4941356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:28.672521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-17941a6b-174b-4bf9-a79a-0ddfd4941356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:28.672978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-17941a6b-174b-4bf9-a79a-0ddfd4941356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:28.673748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-17941a6b-174b-4bf9-a79a-0ddfd4941356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:28.674247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-17941a6b-174b-4bf9-a79a-0ddfd4941356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:28.703291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-17941a6b-174b-4bf9-a79a-0ddfd4941356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042918 Jun 02 16:28:28.703845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 723/1678] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:29.715729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-03f0be92-0343-4b03-919f-06666375c4c3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:29.716657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-03f0be92-0343-4b03-919f-06666375c4c3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:29.723330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03f0be92-0343-4b03-919f-06666375c4c3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:29.723784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03f0be92-0343-4b03-919f-06666375c4c3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:29.724645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03f0be92-0343-4b03-919f-06666375c4c3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:29.725089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-03f0be92-0343-4b03-919f-06666375c4c3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:29.755153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-03f0be92-0343-4b03-919f-06666375c4c3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Jun 02 16:28:29.755700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 956/1679] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:30.766867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f2448ad1-30b3-45b6-908c-41c131b98ba0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:30.767798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f2448ad1-30b3-45b6-908c-41c131b98ba0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:30.774339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2448ad1-30b3-45b6-908c-41c131b98ba0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:30.774791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2448ad1-30b3-45b6-908c-41c131b98ba0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:30.775565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2448ad1-30b3-45b6-908c-41c131b98ba0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:30.775989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f2448ad1-30b3-45b6-908c-41c131b98ba0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:30.804929 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f2448ad1-30b3-45b6-908c-41c131b98ba0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042083 Jun 02 16:28:30.806183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 724/1680] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:31.816870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-caf88891-2b0b-4ab0-b977-60956c9d96e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:31.817796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-caf88891-2b0b-4ab0-b977-60956c9d96e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:31.825093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-caf88891-2b0b-4ab0-b977-60956c9d96e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:31.825539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-caf88891-2b0b-4ab0-b977-60956c9d96e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:31.826328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-caf88891-2b0b-4ab0-b977-60956c9d96e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:31.826767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-caf88891-2b0b-4ab0-b977-60956c9d96e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:31.856094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-caf88891-2b0b-4ab0-b977-60956c9d96e7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043123 Jun 02 16:28:31.856641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 957/1681] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:31 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:28:32.867306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-10d87fea-d378-4f8e-a1b1-db96c40ab524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:32.868505 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-10d87fea-d378-4f8e-a1b1-db96c40ab524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:32.875052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10d87fea-d378-4f8e-a1b1-db96c40ab524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:32.875500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10d87fea-d378-4f8e-a1b1-db96c40ab524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:32.876291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10d87fea-d378-4f8e-a1b1-db96c40ab524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:32.876728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10d87fea-d378-4f8e-a1b1-db96c40ab524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:32.905481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-10d87fea-d378-4f8e-a1b1-db96c40ab524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042172 Jun 02 16:28:32.906026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 725/1682] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:28:33.917369 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-21d633f8-8d69-4e3d-9b06-56f30b7c3de4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:33.918461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-21d633f8-8d69-4e3d-9b06-56f30b7c3de4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:33.924976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21d633f8-8d69-4e3d-9b06-56f30b7c3de4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:33.925430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21d633f8-8d69-4e3d-9b06-56f30b7c3de4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:33.926222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21d633f8-8d69-4e3d-9b06-56f30b7c3de4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:33.926665 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21d633f8-8d69-4e3d-9b06-56f30b7c3de4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:33.956644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-21d633f8-8d69-4e3d-9b06-56f30b7c3de4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043580 Jun 02 16:28:33.957196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 958/1683] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:34.968863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ee0cdf56-25dd-46e9-84c4-1f4aff44371f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:34.969794 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ee0cdf56-25dd-46e9-84c4-1f4aff44371f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:34.976514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee0cdf56-25dd-46e9-84c4-1f4aff44371f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:34.977555 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee0cdf56-25dd-46e9-84c4-1f4aff44371f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:34.978505 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee0cdf56-25dd-46e9-84c4-1f4aff44371f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:34.978978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee0cdf56-25dd-46e9-84c4-1f4aff44371f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:35.008248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ee0cdf56-25dd-46e9-84c4-1f4aff44371f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043390 Jun 02 16:28:35.008602 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 726/1684] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:36.019938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eb867306-0753-44bf-ad55-28dce894bec6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:36.020861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eb867306-0753-44bf-ad55-28dce894bec6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:36.028543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb867306-0753-44bf-ad55-28dce894bec6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:36.028999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb867306-0753-44bf-ad55-28dce894bec6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:36.029767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb867306-0753-44bf-ad55-28dce894bec6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:36.030241 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb867306-0753-44bf-ad55-28dce894bec6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:36.059438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eb867306-0753-44bf-ad55-28dce894bec6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Jun 02 16:28:36.059979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 959/1685] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:36 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:37.071091 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2dfc0424-d0c2-4b2f-be64-a28ae430fa1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:37.072008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2dfc0424-d0c2-4b2f-be64-a28ae430fa1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:37.078583 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2dfc0424-d0c2-4b2f-be64-a28ae430fa1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:37.079036 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2dfc0424-d0c2-4b2f-be64-a28ae430fa1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:37.079801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2dfc0424-d0c2-4b2f-be64-a28ae430fa1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:37.080241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2dfc0424-d0c2-4b2f-be64-a28ae430fa1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:37.082583 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=96 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:37.112291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2dfc0424-d0c2-4b2f-be64-a28ae430fa1f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Jun 02 16:28:37.112291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 727/1686] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:37 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:38.123577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d86bbe19-0141-44ad-aaff-8b0a3915c477 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:38.124485 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d86bbe19-0141-44ad-aaff-8b0a3915c477 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:38.130916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d86bbe19-0141-44ad-aaff-8b0a3915c477 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:38.131357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d86bbe19-0141-44ad-aaff-8b0a3915c477 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:38.132104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d86bbe19-0141-44ad-aaff-8b0a3915c477 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:38.132553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d86bbe19-0141-44ad-aaff-8b0a3915c477 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:38.161512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d86bbe19-0141-44ad-aaff-8b0a3915c477 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 Jun 02 16:28:38.162048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 960/1687] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:38 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:39.173422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0cd581c1-2c5d-4dce-9a47-5744d27e73dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:39.174117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0cd581c1-2c5d-4dce-9a47-5744d27e73dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:39.181014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0cd581c1-2c5d-4dce-9a47-5744d27e73dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:39.181463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0cd581c1-2c5d-4dce-9a47-5744d27e73dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:39.182280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0cd581c1-2c5d-4dce-9a47-5744d27e73dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:39.182719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0cd581c1-2c5d-4dce-9a47-5744d27e73dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:39.212067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0cd581c1-2c5d-4dce-9a47-5744d27e73dd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043016 Jun 02 16:28:39.212619 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 728/1688] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:39.578980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:28:39.579504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:28:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:28:40.224518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ca232c6c-558d-41ea-915d-e31e680d13fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:40.225441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ca232c6c-558d-41ea-915d-e31e680d13fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:40.232212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca232c6c-558d-41ea-915d-e31e680d13fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:40.232672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca232c6c-558d-41ea-915d-e31e680d13fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:40.233443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca232c6c-558d-41ea-915d-e31e680d13fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:40.233884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca232c6c-558d-41ea-915d-e31e680d13fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:40.264022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ca232c6c-558d-41ea-915d-e31e680d13fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043477 Jun 02 16:28:40.264557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 961/1689] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:41.276300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-730bf547-58fc-47e3-b1e0-4756cf1bb0b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:41.277253 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-730bf547-58fc-47e3-b1e0-4756cf1bb0b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:41.283972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-730bf547-58fc-47e3-b1e0-4756cf1bb0b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:41.284418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-730bf547-58fc-47e3-b1e0-4756cf1bb0b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:41.285180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-730bf547-58fc-47e3-b1e0-4756cf1bb0b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:41.285657 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-730bf547-58fc-47e3-b1e0-4756cf1bb0b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:41.313636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-730bf547-58fc-47e3-b1e0-4756cf1bb0b2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041964 Jun 02 16:28:41.314208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 729/1690] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:42.519178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-54ebb300-1f71-47e6-87e0-faaef38505f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:42.520096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-54ebb300-1f71-47e6-87e0-faaef38505f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:42.526974 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54ebb300-1f71-47e6-87e0-faaef38505f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:42.527426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54ebb300-1f71-47e6-87e0-faaef38505f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:42.528194 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54ebb300-1f71-47e6-87e0-faaef38505f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:42.528629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-54ebb300-1f71-47e6-87e0-faaef38505f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:42.558221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-54ebb300-1f71-47e6-87e0-faaef38505f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.237216 Jun 02 16:28:42.558767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 962/1691] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:43.569741 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-43cfec68-804f-47b9-a3f0-e05b06a74ea0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:43.571157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-43cfec68-804f-47b9-a3f0-e05b06a74ea0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:43.577581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43cfec68-804f-47b9-a3f0-e05b06a74ea0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:43.578033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43cfec68-804f-47b9-a3f0-e05b06a74ea0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:43.578831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43cfec68-804f-47b9-a3f0-e05b06a74ea0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:43.579270 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43cfec68-804f-47b9-a3f0-e05b06a74ea0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:43.608838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-43cfec68-804f-47b9-a3f0-e05b06a74ea0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Jun 02 16:28:43.609376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 730/1692] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:43 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:44.623864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-688417f0-29e2-4aa5-b62b-9402a876f997 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:44.623864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-688417f0-29e2-4aa5-b62b-9402a876f997 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:44.624671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=30 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:44.629178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-688417f0-29e2-4aa5-b62b-9402a876f997 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:44.629622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-688417f0-29e2-4aa5-b62b-9402a876f997 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:44.630408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-688417f0-29e2-4aa5-b62b-9402a876f997 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:44.630844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-688417f0-29e2-4aa5-b62b-9402a876f997 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:44.633983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=93 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:44.660752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-688417f0-29e2-4aa5-b62b-9402a876f997 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044392 Jun 02 16:28:44.661294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 963/1693] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:44 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:45.672491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3d3be05c-6f3e-4f25-b8d0-5a3fb1b30f8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:45.673453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3d3be05c-6f3e-4f25-b8d0-5a3fb1b30f8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:45.680033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3d3be05c-6f3e-4f25-b8d0-5a3fb1b30f8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:45.680480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3d3be05c-6f3e-4f25-b8d0-5a3fb1b30f8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:45.681247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3d3be05c-6f3e-4f25-b8d0-5a3fb1b30f8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:45.681687 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3d3be05c-6f3e-4f25-b8d0-5a3fb1b30f8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:45.711777 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3d3be05c-6f3e-4f25-b8d0-5a3fb1b30f8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043271 Jun 02 16:28:45.712345 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 731/1694] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:46.723620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b8ee8ad7-3c52-4a2c-8cfd-5baf8a4895ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:46.724558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b8ee8ad7-3c52-4a2c-8cfd-5baf8a4895ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:46.731886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8ee8ad7-3c52-4a2c-8cfd-5baf8a4895ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:46.732335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8ee8ad7-3c52-4a2c-8cfd-5baf8a4895ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:46.733097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8ee8ad7-3c52-4a2c-8cfd-5baf8a4895ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:46.733562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b8ee8ad7-3c52-4a2c-8cfd-5baf8a4895ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:46.762195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b8ee8ad7-3c52-4a2c-8cfd-5baf8a4895ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042911 Jun 02 16:28:46.762911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 964/1695] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:47.774786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-040fe071-eb7b-4a60-a044-be5e3e8f7474 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:47.775627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-040fe071-eb7b-4a60-a044-be5e3e8f7474 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:47.777601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=32 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:28:47.782372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-040fe071-eb7b-4a60-a044-be5e3e8f7474 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:47.782822 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-040fe071-eb7b-4a60-a044-be5e3e8f7474 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:47.783585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-040fe071-eb7b-4a60-a044-be5e3e8f7474 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:47.784021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-040fe071-eb7b-4a60-a044-be5e3e8f7474 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:47.812882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-040fe071-eb7b-4a60-a044-be5e3e8f7474 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043005 Jun 02 16:28:47.813426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 732/1696] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:47 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:48.824839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ff7b3216-d7c4-46aa-b161-90df679cf3e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:48.825750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ff7b3216-d7c4-46aa-b161-90df679cf3e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:48.832119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ff7b3216-d7c4-46aa-b161-90df679cf3e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:48.832562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ff7b3216-d7c4-46aa-b161-90df679cf3e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:48.833316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ff7b3216-d7c4-46aa-b161-90df679cf3e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:48.833750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ff7b3216-d7c4-46aa-b161-90df679cf3e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:48.863672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ff7b3216-d7c4-46aa-b161-90df679cf3e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Jun 02 16:28:48.864222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 965/1697] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:48 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:49.876530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7c3ca934-15e1-405f-9bfd-fcd19ba999e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:49.877453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7c3ca934-15e1-405f-9bfd-fcd19ba999e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:49.883862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7c3ca934-15e1-405f-9bfd-fcd19ba999e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:49.884317 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7c3ca934-15e1-405f-9bfd-fcd19ba999e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:49.885085 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7c3ca934-15e1-405f-9bfd-fcd19ba999e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:49.885528 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7c3ca934-15e1-405f-9bfd-fcd19ba999e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:49.917101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7c3ca934-15e1-405f-9bfd-fcd19ba999e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Jun 02 16:28:49.917649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 733/1698] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:50.928563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2d79d768-6198-4a98-b775-a3384abdba73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:50.929487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2d79d768-6198-4a98-b775-a3384abdba73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:50.936024 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d79d768-6198-4a98-b775-a3384abdba73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:50.936472 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d79d768-6198-4a98-b775-a3384abdba73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:50.937274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d79d768-6198-4a98-b775-a3384abdba73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:50.937714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d79d768-6198-4a98-b775-a3384abdba73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:50.967273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2d79d768-6198-4a98-b775-a3384abdba73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042731 Jun 02 16:28:50.968062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 966/1699] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:51.980044 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8c3083e6-e5b9-4b8f-9d5c-26ede6564764 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:51.980972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8c3083e6-e5b9-4b8f-9d5c-26ede6564764 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:51.987633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c3083e6-e5b9-4b8f-9d5c-26ede6564764 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:51.988083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c3083e6-e5b9-4b8f-9d5c-26ede6564764 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:51.988849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c3083e6-e5b9-4b8f-9d5c-26ede6564764 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:51.989282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c3083e6-e5b9-4b8f-9d5c-26ede6564764 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:52.018389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8c3083e6-e5b9-4b8f-9d5c-26ede6564764 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043267 Jun 02 16:28:52.018940 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 734/1700] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:53.030130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-246cb6b8-25ab-4ca3-9c5e-fc1aec7075be tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:53.031010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-246cb6b8-25ab-4ca3-9c5e-fc1aec7075be tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:53.037745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-246cb6b8-25ab-4ca3-9c5e-fc1aec7075be tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:53.038211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-246cb6b8-25ab-4ca3-9c5e-fc1aec7075be tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:53.038978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-246cb6b8-25ab-4ca3-9c5e-fc1aec7075be tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:53.039410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-246cb6b8-25ab-4ca3-9c5e-fc1aec7075be tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:53.068563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-246cb6b8-25ab-4ca3-9c5e-fc1aec7075be tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042493 Jun 02 16:28:53.069115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 967/1701] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:53 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:54.080859 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a148ede5-4012-4c67-8589-145a76d8b444 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:54.081776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a148ede5-4012-4c67-8589-145a76d8b444 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:54.088414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a148ede5-4012-4c67-8589-145a76d8b444 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:54.088869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a148ede5-4012-4c67-8589-145a76d8b444 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:54.089636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a148ede5-4012-4c67-8589-145a76d8b444 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:54.090092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a148ede5-4012-4c67-8589-145a76d8b444 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:54.119735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a148ede5-4012-4c67-8589-145a76d8b444 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 Jun 02 16:28:54.120285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 735/1702] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:54 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:55.131439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3c291df4-cc42-4fe8-9208-d59a7f266550 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:55.132290 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3c291df4-cc42-4fe8-9208-d59a7f266550 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:55.139065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c291df4-cc42-4fe8-9208-d59a7f266550 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:55.139517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c291df4-cc42-4fe8-9208-d59a7f266550 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:55.140317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c291df4-cc42-4fe8-9208-d59a7f266550 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:55.140757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3c291df4-cc42-4fe8-9208-d59a7f266550 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:55.170248 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3c291df4-cc42-4fe8-9208-d59a7f266550 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042815 Jun 02 16:28:55.170813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 968/1703] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:56.181946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a0f03580-ff3e-423e-ac46-28aeb892fa81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:56.182900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a0f03580-ff3e-423e-ac46-28aeb892fa81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:56.189634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a0f03580-ff3e-423e-ac46-28aeb892fa81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:56.190098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a0f03580-ff3e-423e-ac46-28aeb892fa81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:56.190879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a0f03580-ff3e-423e-ac46-28aeb892fa81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:56.191321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a0f03580-ff3e-423e-ac46-28aeb892fa81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:56.220980 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a0f03580-ff3e-423e-ac46-28aeb892fa81 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Jun 02 16:28:56.221632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 736/1704] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:57.231851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-83fec1e3-0cfb-4af0-bfa2-e261df262798 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:57.232776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-83fec1e3-0cfb-4af0-bfa2-e261df262798 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:57.239402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83fec1e3-0cfb-4af0-bfa2-e261df262798 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:57.239849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83fec1e3-0cfb-4af0-bfa2-e261df262798 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:57.240616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83fec1e3-0cfb-4af0-bfa2-e261df262798 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:57.241054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-83fec1e3-0cfb-4af0-bfa2-e261df262798 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:57.270312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-83fec1e3-0cfb-4af0-bfa2-e261df262798 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Jun 02 16:28:57.270868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 969/1705] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:57 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:58.281995 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d21bda00-5b7a-44c4-8ed3-a7de97203ef2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:58.282945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d21bda00-5b7a-44c4-8ed3-a7de97203ef2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:58.290128 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d21bda00-5b7a-44c4-8ed3-a7de97203ef2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:58.290587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d21bda00-5b7a-44c4-8ed3-a7de97203ef2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:58.291353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d21bda00-5b7a-44c4-8ed3-a7de97203ef2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:58.291791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d21bda00-5b7a-44c4-8ed3-a7de97203ef2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:58.320170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d21bda00-5b7a-44c4-8ed3-a7de97203ef2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Jun 02 16:28:58.320788 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 737/1706] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:58 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:28:59.331843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9ad27c71-b5f0-4a73-b03f-db9aae221e97 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:28:59.332768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9ad27c71-b5f0-4a73-b03f-db9aae221e97 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:28:59.339397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ad27c71-b5f0-4a73-b03f-db9aae221e97 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:59.339848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ad27c71-b5f0-4a73-b03f-db9aae221e97 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:59.340610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ad27c71-b5f0-4a73-b03f-db9aae221e97 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:28:59.341056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ad27c71-b5f0-4a73-b03f-db9aae221e97 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:28:59.371430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9ad27c71-b5f0-4a73-b03f-db9aae221e97 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 Jun 02 16:28:59.371964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 970/1707] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:28:59 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:00.383780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-11ceb3d3-5dde-41cc-8193-6dc6b2a314b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:00.384685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-11ceb3d3-5dde-41cc-8193-6dc6b2a314b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:00.391124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11ceb3d3-5dde-41cc-8193-6dc6b2a314b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:00.391578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11ceb3d3-5dde-41cc-8193-6dc6b2a314b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:00.392349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11ceb3d3-5dde-41cc-8193-6dc6b2a314b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:00.392814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11ceb3d3-5dde-41cc-8193-6dc6b2a314b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:00.421434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-11ceb3d3-5dde-41cc-8193-6dc6b2a314b8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042387 Jun 02 16:29:00.421980 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 738/1708] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:01.433654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b151843c-83e0-4874-b8bd-178c08fa2581 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:01.434519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b151843c-83e0-4874-b8bd-178c08fa2581 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:01.440903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b151843c-83e0-4874-b8bd-178c08fa2581 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:01.441355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b151843c-83e0-4874-b8bd-178c08fa2581 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:01.442142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b151843c-83e0-4874-b8bd-178c08fa2581 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:01.442581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b151843c-83e0-4874-b8bd-178c08fa2581 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:01.471249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b151843c-83e0-4874-b8bd-178c08fa2581 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 Jun 02 16:29:01.471810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 971/1709] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:01 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:02.482569 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-aa059a07-74aa-4c06-9d68-5f89f253fcf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:02.483411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-aa059a07-74aa-4c06-9d68-5f89f253fcf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:02.489951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa059a07-74aa-4c06-9d68-5f89f253fcf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:02.490443 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa059a07-74aa-4c06-9d68-5f89f253fcf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:02.491205 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa059a07-74aa-4c06-9d68-5f89f253fcf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:02.491645 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aa059a07-74aa-4c06-9d68-5f89f253fcf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:02.520329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-aa059a07-74aa-4c06-9d68-5f89f253fcf4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 Jun 02 16:29:02.520875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 739/1710] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:03.532035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e2d26642-4efe-4d1e-85f9-8abe4f102755 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:03.532880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e2d26642-4efe-4d1e-85f9-8abe4f102755 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:03.540175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2d26642-4efe-4d1e-85f9-8abe4f102755 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:03.540630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2d26642-4efe-4d1e-85f9-8abe4f102755 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:03.541396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2d26642-4efe-4d1e-85f9-8abe4f102755 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:03.541835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2d26642-4efe-4d1e-85f9-8abe4f102755 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:03.570035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e2d26642-4efe-4d1e-85f9-8abe4f102755 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042121 Jun 02 16:29:03.570692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 972/1711] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:03 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:04.581706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9e67385f-29f5-407d-ba76-3a29c4b691ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:04.582568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9e67385f-29f5-407d-ba76-3a29c4b691ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:04.589093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9e67385f-29f5-407d-ba76-3a29c4b691ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:04.589547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9e67385f-29f5-407d-ba76-3a29c4b691ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:04.590347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9e67385f-29f5-407d-ba76-3a29c4b691ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:04.590793 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9e67385f-29f5-407d-ba76-3a29c4b691ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:04.620868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9e67385f-29f5-407d-ba76-3a29c4b691ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043252 Jun 02 16:29:04.621411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 740/1712] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:04 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:05.632711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d175f618-9559-421d-a3db-c05eecdf32b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:05.634612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d175f618-9559-421d-a3db-c05eecdf32b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:05.640686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d175f618-9559-421d-a3db-c05eecdf32b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:05.641125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d175f618-9559-421d-a3db-c05eecdf32b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:05.641878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d175f618-9559-421d-a3db-c05eecdf32b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:05.642341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d175f618-9559-421d-a3db-c05eecdf32b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:05.671576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d175f618-9559-421d-a3db-c05eecdf32b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Jun 02 16:29:05.672128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 973/1713] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:06.684012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-22c6acff-a736-49b4-bbbf-7cef2e850e04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:06.684938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-22c6acff-a736-49b4-bbbf-7cef2e850e04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:06.691588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22c6acff-a736-49b4-bbbf-7cef2e850e04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:06.692033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22c6acff-a736-49b4-bbbf-7cef2e850e04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:06.692793 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22c6acff-a736-49b4-bbbf-7cef2e850e04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:06.693227 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22c6acff-a736-49b4-bbbf-7cef2e850e04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:06.721576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-22c6acff-a736-49b4-bbbf-7cef2e850e04 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042253 Jun 02 16:29:06.722150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 741/1714] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:07.732972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f1edd766-e4ac-40df-b421-4f3fe92cd041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:07.733900 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f1edd766-e4ac-40df-b421-4f3fe92cd041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:07.740464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1edd766-e4ac-40df-b421-4f3fe92cd041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:07.740905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1edd766-e4ac-40df-b421-4f3fe92cd041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:07.741668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1edd766-e4ac-40df-b421-4f3fe92cd041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:07.742130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1edd766-e4ac-40df-b421-4f3fe92cd041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:07.771926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f1edd766-e4ac-40df-b421-4f3fe92cd041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042899 Jun 02 16:29:07.772480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 974/1715] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:08.783433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a1d4941d-30cb-407f-a86d-732ac361564c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:08.784351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a1d4941d-30cb-407f-a86d-732ac361564c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:08.791635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a1d4941d-30cb-407f-a86d-732ac361564c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:08.792081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a1d4941d-30cb-407f-a86d-732ac361564c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:08.793257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a1d4941d-30cb-407f-a86d-732ac361564c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:08.793257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a1d4941d-30cb-407f-a86d-732ac361564c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:08.822578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a1d4941d-30cb-407f-a86d-732ac361564c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Jun 02 16:29:08.823118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 742/1716] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:08 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:09.834189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3f6c7ec5-a105-4b27-9aac-e0767d2b6420 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:09.835109 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3f6c7ec5-a105-4b27-9aac-e0767d2b6420 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:09.841934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3f6c7ec5-a105-4b27-9aac-e0767d2b6420 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:09.842419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3f6c7ec5-a105-4b27-9aac-e0767d2b6420 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:09.843457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3f6c7ec5-a105-4b27-9aac-e0767d2b6420 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:09.843894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3f6c7ec5-a105-4b27-9aac-e0767d2b6420 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:09.872127 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3f6c7ec5-a105-4b27-9aac-e0767d2b6420 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041994 Jun 02 16:29:09.872672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 975/1717] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:10.883835 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-77eb6eb8-4396-45a1-8878-9640362e7aa5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:10.884753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-77eb6eb8-4396-45a1-8878-9640362e7aa5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:10.891624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77eb6eb8-4396-45a1-8878-9640362e7aa5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:10.892066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77eb6eb8-4396-45a1-8878-9640362e7aa5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:10.892827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77eb6eb8-4396-45a1-8878-9640362e7aa5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:10.893260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77eb6eb8-4396-45a1-8878-9640362e7aa5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:10.895692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=96 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:29:10.924601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-77eb6eb8-4396-45a1-8878-9640362e7aa5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Jun 02 16:29:10.927049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 743/1718] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:10 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:29:11.937052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e795be17-b95b-4fe6-bfd3-60831e4a7db8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:11.937984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e795be17-b95b-4fe6-bfd3-60831e4a7db8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:11.944417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e795be17-b95b-4fe6-bfd3-60831e4a7db8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:11.944929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e795be17-b95b-4fe6-bfd3-60831e4a7db8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:11.945822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e795be17-b95b-4fe6-bfd3-60831e4a7db8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:11.946315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e795be17-b95b-4fe6-bfd3-60831e4a7db8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:11.974774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e795be17-b95b-4fe6-bfd3-60831e4a7db8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 Jun 02 16:29:11.975319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 976/1719] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:11 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:12.987291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ac0c9fc8-279f-45d2-84dc-954547350359 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:12.988204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ac0c9fc8-279f-45d2-84dc-954547350359 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:12.995738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac0c9fc8-279f-45d2-84dc-954547350359 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:12.996185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac0c9fc8-279f-45d2-84dc-954547350359 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:12.996936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac0c9fc8-279f-45d2-84dc-954547350359 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:12.997367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ac0c9fc8-279f-45d2-84dc-954547350359 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:13.025930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ac0c9fc8-279f-45d2-84dc-954547350359 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042924 Jun 02 16:29:13.026492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 744/1720] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:14.037186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1e8bc99b-a29c-431f-9570-e15d0d285da4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:14.038120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1e8bc99b-a29c-431f-9570-e15d0d285da4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:14.045166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e8bc99b-a29c-431f-9570-e15d0d285da4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:14.045613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e8bc99b-a29c-431f-9570-e15d0d285da4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:14.046409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e8bc99b-a29c-431f-9570-e15d0d285da4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:14.046845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1e8bc99b-a29c-431f-9570-e15d0d285da4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:14.074902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1e8bc99b-a29c-431f-9570-e15d0d285da4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041728 Jun 02 16:29:14.075442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 977/1721] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:15.086707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a66dc771-8378-45dd-9d11-506defb6860c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:15.087598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a66dc771-8378-45dd-9d11-506defb6860c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:15.094379 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a66dc771-8378-45dd-9d11-506defb6860c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:15.094830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a66dc771-8378-45dd-9d11-506defb6860c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:15.095595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a66dc771-8378-45dd-9d11-506defb6860c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:15.096035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a66dc771-8378-45dd-9d11-506defb6860c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:15.126366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a66dc771-8378-45dd-9d11-506defb6860c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Jun 02 16:29:15.126928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 745/1722] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:15 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:16.138115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9f339015-c770-4c6b-897d-9bb90ebd8224 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:16.139087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9f339015-c770-4c6b-897d-9bb90ebd8224 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:16.145490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f339015-c770-4c6b-897d-9bb90ebd8224 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:16.145937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f339015-c770-4c6b-897d-9bb90ebd8224 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:16.146729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f339015-c770-4c6b-897d-9bb90ebd8224 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:16.147165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9f339015-c770-4c6b-897d-9bb90ebd8224 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:16.176569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9f339015-c770-4c6b-897d-9bb90ebd8224 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Jun 02 16:29:16.177121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 978/1723] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:29:17.188300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-59904daf-73d2-46d6-afea-b6827c0f9498 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:17.189221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-59904daf-73d2-46d6-afea-b6827c0f9498 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:17.196399 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59904daf-73d2-46d6-afea-b6827c0f9498 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:17.196556 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59904daf-73d2-46d6-afea-b6827c0f9498 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:17.197271 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59904daf-73d2-46d6-afea-b6827c0f9498 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:17.197709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59904daf-73d2-46d6-afea-b6827c0f9498 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:17.227034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-59904daf-73d2-46d6-afea-b6827c0f9498 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Jun 02 16:29:17.227530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 746/1724] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:18.238577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b7609173-42e0-452a-a581-3076013dc3d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:18.239425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b7609173-42e0-452a-a581-3076013dc3d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:18.241844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=32 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:29:18.247203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b7609173-42e0-452a-a581-3076013dc3d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:18.247650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b7609173-42e0-452a-a581-3076013dc3d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:18.248454 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b7609173-42e0-452a-a581-3076013dc3d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:18.248888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b7609173-42e0-452a-a581-3076013dc3d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:18.252386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=96 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:29:18.278199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b7609173-42e0-452a-a581-3076013dc3d2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043647 Jun 02 16:29:18.278736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 979/1725] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:19.289074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ce38fc3e-a790-430b-adc0-3e4237c0f543 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:19.290003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ce38fc3e-a790-430b-adc0-3e4237c0f543 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:19.296616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce38fc3e-a790-430b-adc0-3e4237c0f543 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:19.297067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce38fc3e-a790-430b-adc0-3e4237c0f543 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:19.297829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce38fc3e-a790-430b-adc0-3e4237c0f543 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:19.298301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce38fc3e-a790-430b-adc0-3e4237c0f543 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:19.327942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ce38fc3e-a790-430b-adc0-3e4237c0f543 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042870 Jun 02 16:29:19.328488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 747/1726] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:19 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:20.339868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9901ecc6-28e6-4c9f-a2df-d446de75da7d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:20.340792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9901ecc6-28e6-4c9f-a2df-d446de75da7d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:20.347598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9901ecc6-28e6-4c9f-a2df-d446de75da7d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:20.348047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9901ecc6-28e6-4c9f-a2df-d446de75da7d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:20.348811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9901ecc6-28e6-4c9f-a2df-d446de75da7d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:20.349245 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9901ecc6-28e6-4c9f-a2df-d446de75da7d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:20.378943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9901ecc6-28e6-4c9f-a2df-d446de75da7d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Jun 02 16:29:20.379494 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 980/1727] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:21.390250 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-be60fdfc-a9f8-4449-95aa-675965d79d4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:21.394994 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-be60fdfc-a9f8-4449-95aa-675965d79d4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:21.394994 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=32 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:29:21.398775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be60fdfc-a9f8-4449-95aa-675965d79d4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:21.399861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be60fdfc-a9f8-4449-95aa-675965d79d4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:21.400653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be60fdfc-a9f8-4449-95aa-675965d79d4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:21.401113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-be60fdfc-a9f8-4449-95aa-675965d79d4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:21.430153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-be60fdfc-a9f8-4449-95aa-675965d79d4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Jun 02 16:29:21.430665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 748/1728] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:22.440945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-725c65ee-93da-4a45-9f30-7c89ced7528c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:22.442489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-725c65ee-93da-4a45-9f30-7c89ced7528c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:22.448998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-725c65ee-93da-4a45-9f30-7c89ced7528c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:22.449446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-725c65ee-93da-4a45-9f30-7c89ced7528c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:22.450266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-725c65ee-93da-4a45-9f30-7c89ced7528c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:22.450704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-725c65ee-93da-4a45-9f30-7c89ced7528c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:22.479897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-725c65ee-93da-4a45-9f30-7c89ced7528c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043009 Jun 02 16:29:22.480443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 981/1729] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:23.491737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ebd3b3f1-a3fa-47b6-82e3-5f07a3756e89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:23.492592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ebd3b3f1-a3fa-47b6-82e3-5f07a3756e89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:23.500159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebd3b3f1-a3fa-47b6-82e3-5f07a3756e89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:23.500596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebd3b3f1-a3fa-47b6-82e3-5f07a3756e89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:23.501352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebd3b3f1-a3fa-47b6-82e3-5f07a3756e89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:23.501782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebd3b3f1-a3fa-47b6-82e3-5f07a3756e89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:23.530606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ebd3b3f1-a3fa-47b6-82e3-5f07a3756e89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042932 Jun 02 16:29:23.531149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 749/1730] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:24.543288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-29b186b2-8a7b-411d-acb3-63ff92825306 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:24.544210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-29b186b2-8a7b-411d-acb3-63ff92825306 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:24.550770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29b186b2-8a7b-411d-acb3-63ff92825306 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:24.551222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29b186b2-8a7b-411d-acb3-63ff92825306 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:24.551991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29b186b2-8a7b-411d-acb3-63ff92825306 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:24.552426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-29b186b2-8a7b-411d-acb3-63ff92825306 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:24.581119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-29b186b2-8a7b-411d-acb3-63ff92825306 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042644 Jun 02 16:29:24.581672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 982/1731] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:25.592998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4b208b7d-3ea7-46c1-b123-ef2cd2254b39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:25.594575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4b208b7d-3ea7-46c1-b123-ef2cd2254b39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:25.601113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b208b7d-3ea7-46c1-b123-ef2cd2254b39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:25.601557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b208b7d-3ea7-46c1-b123-ef2cd2254b39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:25.603004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b208b7d-3ea7-46c1-b123-ef2cd2254b39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:25.603380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b208b7d-3ea7-46c1-b123-ef2cd2254b39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:25.632062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4b208b7d-3ea7-46c1-b123-ef2cd2254b39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Jun 02 16:29:25.632604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 750/1732] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:25 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:26.643820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3ea4be57-ea5d-4288-9f67-72167b47fbb8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:26.644764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3ea4be57-ea5d-4288-9f67-72167b47fbb8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:26.652047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ea4be57-ea5d-4288-9f67-72167b47fbb8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:26.652483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ea4be57-ea5d-4288-9f67-72167b47fbb8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:26.653235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ea4be57-ea5d-4288-9f67-72167b47fbb8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:26.653666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ea4be57-ea5d-4288-9f67-72167b47fbb8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:26.682916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3ea4be57-ea5d-4288-9f67-72167b47fbb8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043070 Jun 02 16:29:26.683463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 983/1733] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:27.694339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-11ba0691-089f-4047-b3b1-f1bc89129077 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:27.695324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-11ba0691-089f-4047-b3b1-f1bc89129077 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:27.702255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11ba0691-089f-4047-b3b1-f1bc89129077 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:27.702716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11ba0691-089f-4047-b3b1-f1bc89129077 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:27.703492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11ba0691-089f-4047-b3b1-f1bc89129077 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:27.703937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11ba0691-089f-4047-b3b1-f1bc89129077 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:27.733841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-11ba0691-089f-4047-b3b1-f1bc89129077 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Jun 02 16:29:27.734441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 751/1734] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:28.746436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-86ded0d2-c16c-4b02-88ab-768671e0e131 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:28.747351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-86ded0d2-c16c-4b02-88ab-768671e0e131 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:28.753723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86ded0d2-c16c-4b02-88ab-768671e0e131 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:28.754199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86ded0d2-c16c-4b02-88ab-768671e0e131 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:28.754953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86ded0d2-c16c-4b02-88ab-768671e0e131 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:28.755484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86ded0d2-c16c-4b02-88ab-768671e0e131 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:28.784614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-86ded0d2-c16c-4b02-88ab-768671e0e131 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043068 Jun 02 16:29:28.785149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 984/1735] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:29.796566 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-381d03c7-c820-49ec-bb3d-219104890efe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:29.797548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-381d03c7-c820-49ec-bb3d-219104890efe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:29.804099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381d03c7-c820-49ec-bb3d-219104890efe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:29.804546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381d03c7-c820-49ec-bb3d-219104890efe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:29.805329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381d03c7-c820-49ec-bb3d-219104890efe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:29.805739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381d03c7-c820-49ec-bb3d-219104890efe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:29.833549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-381d03c7-c820-49ec-bb3d-219104890efe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040922 Jun 02 16:29:29.834110 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 752/1736] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:30.845239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-73f36985-ca06-49ce-98e1-37caa4a3c760 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:30.846220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-73f36985-ca06-49ce-98e1-37caa4a3c760 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:30.853191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-73f36985-ca06-49ce-98e1-37caa4a3c760 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:30.853629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-73f36985-ca06-49ce-98e1-37caa4a3c760 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:30.854408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-73f36985-ca06-49ce-98e1-37caa4a3c760 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:30.854842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-73f36985-ca06-49ce-98e1-37caa4a3c760 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:30.884237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-73f36985-ca06-49ce-98e1-37caa4a3c760 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 Jun 02 16:29:30.884794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 985/1737] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:31.895951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-80d5c56e-b649-4a63-81d4-37b379b4092d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:31.896934 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-80d5c56e-b649-4a63-81d4-37b379b4092d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:31.903588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80d5c56e-b649-4a63-81d4-37b379b4092d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:31.904043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80d5c56e-b649-4a63-81d4-37b379b4092d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:31.904813 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80d5c56e-b649-4a63-81d4-37b379b4092d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:31.905255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-80d5c56e-b649-4a63-81d4-37b379b4092d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:31.934002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-80d5c56e-b649-4a63-81d4-37b379b4092d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042059 Jun 02 16:29:31.934575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 753/1738] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:31 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:32.944912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0118d4ea-871b-486c-97ba-5feb27d32553 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:32.946655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0118d4ea-871b-486c-97ba-5feb27d32553 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:32.953065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0118d4ea-871b-486c-97ba-5feb27d32553 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:32.953518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0118d4ea-871b-486c-97ba-5feb27d32553 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:32.954321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0118d4ea-871b-486c-97ba-5feb27d32553 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:32.954765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0118d4ea-871b-486c-97ba-5feb27d32553 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:32.984553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0118d4ea-871b-486c-97ba-5feb27d32553 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Jun 02 16:29:32.985079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 986/1739] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:33.995999 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e16fe3bd-52ce-40e1-bfc2-5e57835aff68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:33.996921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e16fe3bd-52ce-40e1-bfc2-5e57835aff68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:34.003405 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e16fe3bd-52ce-40e1-bfc2-5e57835aff68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:34.003853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e16fe3bd-52ce-40e1-bfc2-5e57835aff68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:34.004616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e16fe3bd-52ce-40e1-bfc2-5e57835aff68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:34.005051 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e16fe3bd-52ce-40e1-bfc2-5e57835aff68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:34.033665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e16fe3bd-52ce-40e1-bfc2-5e57835aff68 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042206 Jun 02 16:29:34.034240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 754/1740] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:35.045747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-612ffffd-9417-4a7e-9d5a-a6efcb6f29ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:35.046737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-612ffffd-9417-4a7e-9d5a-a6efcb6f29ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:35.053145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-612ffffd-9417-4a7e-9d5a-a6efcb6f29ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:35.053599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-612ffffd-9417-4a7e-9d5a-a6efcb6f29ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:35.054399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-612ffffd-9417-4a7e-9d5a-a6efcb6f29ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:35.055416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-612ffffd-9417-4a7e-9d5a-a6efcb6f29ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:35.084861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-612ffffd-9417-4a7e-9d5a-a6efcb6f29ba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043102 Jun 02 16:29:35.085427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 987/1741] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:35 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:36.097443 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e6ec14dd-425c-48d5-b6b6-8311dea0bb22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:36.098387 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e6ec14dd-425c-48d5-b6b6-8311dea0bb22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:36.104951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6ec14dd-425c-48d5-b6b6-8311dea0bb22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:36.105397 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6ec14dd-425c-48d5-b6b6-8311dea0bb22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:36.106177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6ec14dd-425c-48d5-b6b6-8311dea0bb22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:36.106616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6ec14dd-425c-48d5-b6b6-8311dea0bb22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:36.135119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e6ec14dd-425c-48d5-b6b6-8311dea0bb22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041680 Jun 02 16:29:36.135655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 755/1742] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:36 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:37.146273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eb69f76d-3ccd-48f0-8849-209cb463976e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:37.147115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eb69f76d-3ccd-48f0-8849-209cb463976e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:37.154104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb69f76d-3ccd-48f0-8849-209cb463976e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:37.154569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb69f76d-3ccd-48f0-8849-209cb463976e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:37.155330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb69f76d-3ccd-48f0-8849-209cb463976e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:37.155764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb69f76d-3ccd-48f0-8849-209cb463976e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:37.185775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eb69f76d-3ccd-48f0-8849-209cb463976e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Jun 02 16:29:37.186361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 988/1743] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:37 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:38.197418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-622567de-59e8-4a8c-9e60-41b8ddb6a14a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:38.198380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-622567de-59e8-4a8c-9e60-41b8ddb6a14a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:38.204873 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-622567de-59e8-4a8c-9e60-41b8ddb6a14a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:38.205323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-622567de-59e8-4a8c-9e60-41b8ddb6a14a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:38.206106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-622567de-59e8-4a8c-9e60-41b8ddb6a14a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:38.206546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-622567de-59e8-4a8c-9e60-41b8ddb6a14a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:38.235563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-622567de-59e8-4a8c-9e60-41b8ddb6a14a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042285 Jun 02 16:29:38.236116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 756/1744] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:38 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:39.247731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6480b1df-19d8-4d01-a5f0-481ed08116d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:39.248689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6480b1df-19d8-4d01-a5f0-481ed08116d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:39.255219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6480b1df-19d8-4d01-a5f0-481ed08116d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:39.255675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6480b1df-19d8-4d01-a5f0-481ed08116d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:39.256441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6480b1df-19d8-4d01-a5f0-481ed08116d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:39.256884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6480b1df-19d8-4d01-a5f0-481ed08116d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:39.286150 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6480b1df-19d8-4d01-a5f0-481ed08116d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Jun 02 16:29:39.286697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 989/1745] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:40.298536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ca6f9035-301d-4a8a-8217-8682c672fad3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:40.299511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ca6f9035-301d-4a8a-8217-8682c672fad3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:40.306533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ca6f9035-301d-4a8a-8217-8682c672fad3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:40.306987 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ca6f9035-301d-4a8a-8217-8682c672fad3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:40.307806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ca6f9035-301d-4a8a-8217-8682c672fad3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:40.308245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ca6f9035-301d-4a8a-8217-8682c672fad3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:40.338813 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ca6f9035-301d-4a8a-8217-8682c672fad3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Jun 02 16:29:40.339727 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 757/1746] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:29:41.351226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ba0ba0f9-b7ce-4b00-8b25-a8e7a9286dc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:29:41.352199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ba0ba0f9-b7ce-4b00-8b25-a8e7a9286dc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:41.358243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ba0ba0f9-b7ce-4b00-8b25-a8e7a9286dc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:41.358701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ba0ba0f9-b7ce-4b00-8b25-a8e7a9286dc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:41.359472 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ba0ba0f9-b7ce-4b00-8b25-a8e7a9286dc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:41.359914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ba0ba0f9-b7ce-4b00-8b25-a8e7a9286dc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:41.388735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ba0ba0f9-b7ce-4b00-8b25-a8e7a9286dc9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 Jun 02 16:29:41.389281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 990/1747] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:29:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:29:42.400895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6d76c8d5-7255-4d81-a7c3-14a55a137524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:29:42.401821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6d76c8d5-7255-4d81-a7c3-14a55a137524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:29:42.408469 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6d76c8d5-7255-4d81-a7c3-14a55a137524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:42.408940 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6d76c8d5-7255-4d81-a7c3-14a55a137524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:42.409697 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6d76c8d5-7255-4d81-a7c3-14a55a137524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:29:42.410201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6d76c8d5-7255-4d81-a7c3-14a55a137524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:29:42.504072 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6d76c8d5-7255-4d81-a7c3-14a55a137524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "POST /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/action" status: 200 len: 41130 microversion: 2.1 time: 0.107403 Jun 02 16:29:42.504652 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 758/1748] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jun 2 16:29:42 2022] POST /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/action => generated 41130 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 16:29:50.883096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:29:50.883604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:29:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:29:52.377348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:29:52.377952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:31:40.093370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:31:40.093936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:31:46.172040 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:31:46.172746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:31:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:31:59.587556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:31:59.588130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:33:10.891620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:33:10.892260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:33:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:33:12.385741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:33:12.386407 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:33:42.544480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03f18a5f-16f8-4d1e-9b11-19a2f9ea635f] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 02 16:33:42.545262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=23 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:42.546177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=71 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:42.549833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:42.550351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:42.557061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:42.557509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:42.562460 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:42.562460 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:42.572774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] HTTP exception thrown: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Request method failure captured: Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: DELETE /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc HTTP/1.1 Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOBfxS4cclfKx3-RndKo8Dh-CNumTLJ_9ppQhQQxKyMPB4EEBU5GFxYA9-LhBrKjDNTyWY87gQZT1pZartY-1sBtFZIfC7qCMEO9Vkk6hprpWxRiJCu0PbwNFMbxNPkdwvsf8s6P7LrQQqRis9Yox-jWNZMH13qPm6c5jIeo1Wfiw4g Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:33:42.574424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}] Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 95108cdd8e134be3823d5024f7037b3e Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.577836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': 'f8bf99ae-5d36-4add-b49f-746e933e19cc'} Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:33:42.579038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.582177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.584442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Returning 404 to user: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:33:42.584442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-865077bc-bd77-45e8-9383-3dd3cf5c456b tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 404 len: 111 microversion: 2.20 time: 0.033254 Jun 02 16:33:42.584442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 991/1749] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jun 2 16:33:42 2022] DELETE /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:33:42.584976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0b26d8c-50e0-4499-bd8d-bed6311a08a7] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 02 16:33:42.589026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:42.590383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] [instance: f8bf99ae-5d36-4add-b49f-746e933e19cc] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:42.592234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=21 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:42.593428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=93 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:33:42.593572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c62004b8-ecbc-4226-82f7-d9c11987475a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:42.594058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c62004b8-ecbc-4226-82f7-d9c11987475a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:42.599600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:42.600065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:42.600834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c62004b8-ecbc-4226-82f7-d9c11987475a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:42.600970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:42.601275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:42.601401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c62004b8-ecbc-4226-82f7-d9c11987475a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:42.602162 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c62004b8-ecbc-4226-82f7-d9c11987475a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:42.602597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c62004b8-ecbc-4226-82f7-d9c11987475a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:42.616852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] HTTP exception thrown: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Request method failure captured: Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc HTTP/1.1 Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOBfxS4cclfKx3-RndKo8Dh-CNumTLJ_9ppQhQQxKyMPB4EEBU5GFxYA9-LhBrKjDNTyWY87gQZT1pZartY-1sBtFZIfC7qCMEO9Vkk6hprpWxRiJCu0PbwNFMbxNPkdwvsf8s6P7LrQQqRis9Yox-jWNZMH13qPm6c5jIeo1Wfiw4g Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:33:42.618546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/470abf75f36f4a84b9382efc2aa2fc1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/470abf75f36f4a84b9382efc2aa2fc1c"}]}] Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 470abf75f36f4a84b9382efc2aa2fc1c Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1288467038 Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 95108cdd8e134be3823d5024f7037b3e Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1288467038-project Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.620058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': 'f8bf99ae-5d36-4add-b49f-746e933e19cc'} Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:33:42.620979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. Jun 02 16:33:42.623598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:33:42.624832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] Returning 404 to user: Instance f8bf99ae-5d36-4add-b49f-746e933e19cc could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:33:42.624832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bff17af2-6d8f-4adc-aa6a-d59ce0e6c99d tempest-AttachVolumeShelveTestJSON-1288467038 tempest-AttachVolumeShelveTestJSON-1288467038-project] 10.222.0.59 "GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc" status: 404 len: 111 microversion: 2.20 time: 0.039184 Jun 02 16:33:42.624832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 759/1750] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jun 2 16:33:42 2022] GET /compute/v2.1/servers/f8bf99ae-5d36-4add-b49f-746e933e19cc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 02 16:33:42.632716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c62004b8-ecbc-4226-82f7-d9c11987475a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:33:42.925250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c62004b8-ecbc-4226-82f7-d9c11987475a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 204 len: 0 microversion: 2.1 time: 0.335000 Jun 02 16:33:42.925957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 992/1751] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:33:42 2022] DELETE /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 02 16:33:42.935442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bc6d81f6-261c-42fa-8a49-4369c7b5695c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:42.936421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bc6d81f6-261c-42fa-8a49-4369c7b5695c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:42.944500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bc6d81f6-261c-42fa-8a49-4369c7b5695c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:42.944963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bc6d81f6-261c-42fa-8a49-4369c7b5695c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:42.945780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bc6d81f6-261c-42fa-8a49-4369c7b5695c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:42.946301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bc6d81f6-261c-42fa-8a49-4369c7b5695c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:43.272959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bc6d81f6-261c-42fa-8a49-4369c7b5695c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:43.281838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bc6d81f6-261c-42fa-8a49-4369c7b5695c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.351661 Jun 02 16:33:43.282524 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 760/1752] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:42 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:44.300265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-986c28d9-0ba5-48fa-90f6-6e96527d8cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:44.300987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-986c28d9-0ba5-48fa-90f6-6e96527d8cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:44.309151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-986c28d9-0ba5-48fa-90f6-6e96527d8cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:44.309606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-986c28d9-0ba5-48fa-90f6-6e96527d8cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:44.310419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-986c28d9-0ba5-48fa-90f6-6e96527d8cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:44.310870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-986c28d9-0ba5-48fa-90f6-6e96527d8cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:44.316677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] [03f18a5f-16f8-4d1e-9b11-19a2f9ea635f] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 54884. Jun 02 16:33:44.511385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-986c28d9-0ba5-48fa-90f6-6e96527d8cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:44.520082 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-986c28d9-0ba5-48fa-90f6-6e96527d8cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.224072 Jun 02 16:33:44.520740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 993/1753] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:44 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:44.858908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-aef6706f-7588-4c97-987d-5eb54cc3c557 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] Calling method '.version_select at 0x7f2d5c1d4700>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:44.882692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0b26d8c-50e0-4499-bd8d-bed6311a08a7] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 54898. Jun 02 16:33:44.972297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-aef6706f-7588-4c97-987d-5eb54cc3c557 tempest-TestVolumeBootPattern-307656481 tempest-TestVolumeBootPattern-307656481-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1652600266" status: 202 len: 0 microversion: 2.1 time: 0.117640 Jun 02 16:33:44.972929 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 761/1754] 10.222.0.59 () {58 vars in 1262 bytes} [Thu Jun 2 16:33:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1652600266 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:33:45.537684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cd2ff139-3254-4d44-9348-106d7c07b672 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:45.538282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cd2ff139-3254-4d44-9348-106d7c07b672 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:45.544803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd2ff139-3254-4d44-9348-106d7c07b672 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:45.545257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd2ff139-3254-4d44-9348-106d7c07b672 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:45.546033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd2ff139-3254-4d44-9348-106d7c07b672 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:45.546507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cd2ff139-3254-4d44-9348-106d7c07b672 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:45.793720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cd2ff139-3254-4d44-9348-106d7c07b672 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:45.805416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cd2ff139-3254-4d44-9348-106d7c07b672 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.272179 Jun 02 16:33:45.806000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 994/1755] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:45 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:46.822611 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5d59061b-fb3d-4169-aa37-9cfd261834a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:46.823344 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5d59061b-fb3d-4169-aa37-9cfd261834a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:46.829562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5d59061b-fb3d-4169-aa37-9cfd261834a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:46.830112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5d59061b-fb3d-4169-aa37-9cfd261834a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:46.831160 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5d59061b-fb3d-4169-aa37-9cfd261834a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:46.831666 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5d59061b-fb3d-4169-aa37-9cfd261834a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:47.029922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5d59061b-fb3d-4169-aa37-9cfd261834a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:47.044013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5d59061b-fb3d-4169-aa37-9cfd261834a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.225715 Jun 02 16:33:47.044563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 762/1756] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:46 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:48.065564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a63100a9-f420-43a4-9b14-9637360c529d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:48.066508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a63100a9-f420-43a4-9b14-9637360c529d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:48.077373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a63100a9-f420-43a4-9b14-9637360c529d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:48.077875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a63100a9-f420-43a4-9b14-9637360c529d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:48.078751 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a63100a9-f420-43a4-9b14-9637360c529d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:48.079224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a63100a9-f420-43a4-9b14-9637360c529d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:48.241733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a63100a9-f420-43a4-9b14-9637360c529d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:48.250158 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a63100a9-f420-43a4-9b14-9637360c529d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.188493 Jun 02 16:33:48.254259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 995/1757] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:48 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:49.274062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-afcdc3e5-9cf0-4191-85e7-1d5b8a259aa4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:49.274820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-afcdc3e5-9cf0-4191-85e7-1d5b8a259aa4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:49.283868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-afcdc3e5-9cf0-4191-85e7-1d5b8a259aa4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:49.284494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-afcdc3e5-9cf0-4191-85e7-1d5b8a259aa4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:49.286141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-afcdc3e5-9cf0-4191-85e7-1d5b8a259aa4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:49.286595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-afcdc3e5-9cf0-4191-85e7-1d5b8a259aa4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:49.457383 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-afcdc3e5-9cf0-4191-85e7-1d5b8a259aa4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:49.476374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-afcdc3e5-9cf0-4191-85e7-1d5b8a259aa4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.211200 Jun 02 16:33:49.477158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 763/1758] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:49 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:33:50.493938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bf7ae76e-0168-4a2e-9a58-34af2f06c212 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:50.494699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bf7ae76e-0168-4a2e-9a58-34af2f06c212 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:50.501588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf7ae76e-0168-4a2e-9a58-34af2f06c212 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:50.502191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf7ae76e-0168-4a2e-9a58-34af2f06c212 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:50.503068 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf7ae76e-0168-4a2e-9a58-34af2f06c212 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:50.504264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf7ae76e-0168-4a2e-9a58-34af2f06c212 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:50.721742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bf7ae76e-0168-4a2e-9a58-34af2f06c212 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:50.738021 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bf7ae76e-0168-4a2e-9a58-34af2f06c212 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.243035 Jun 02 16:33:50.738021 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 996/1759] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:50 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:51.753134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3f3d51ae-0dcb-4c15-a8cd-9ea72b3f3a37 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:51.754013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3f3d51ae-0dcb-4c15-a8cd-9ea72b3f3a37 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:51.760418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f3d51ae-0dcb-4c15-a8cd-9ea72b3f3a37 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:51.761147 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f3d51ae-0dcb-4c15-a8cd-9ea72b3f3a37 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:51.762311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f3d51ae-0dcb-4c15-a8cd-9ea72b3f3a37 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:51.762902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3f3d51ae-0dcb-4c15-a8cd-9ea72b3f3a37 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:51.930210 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3f3d51ae-0dcb-4c15-a8cd-9ea72b3f3a37 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:51.942420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3f3d51ae-0dcb-4c15-a8cd-9ea72b3f3a37 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.192527 Jun 02 16:33:51.948041 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 764/1760] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:51 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:52.964294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9c89d912-0a06-48e0-bfe7-43126eeef640 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:52.966036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9c89d912-0a06-48e0-bfe7-43126eeef640 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:52.982945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c89d912-0a06-48e0-bfe7-43126eeef640 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:52.983802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c89d912-0a06-48e0-bfe7-43126eeef640 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:52.984906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c89d912-0a06-48e0-bfe7-43126eeef640 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:52.985598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c89d912-0a06-48e0-bfe7-43126eeef640 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:53.463592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9c89d912-0a06-48e0-bfe7-43126eeef640 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:53.475299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9c89d912-0a06-48e0-bfe7-43126eeef640 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.518704 Jun 02 16:33:53.476395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 997/1761] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:52 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:54.496023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-60608ed5-a8bc-4987-ba52-cf2226c31694 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:54.497004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-60608ed5-a8bc-4987-ba52-cf2226c31694 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:54.508325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60608ed5-a8bc-4987-ba52-cf2226c31694 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:54.510296 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60608ed5-a8bc-4987-ba52-cf2226c31694 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:54.511500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60608ed5-a8bc-4987-ba52-cf2226c31694 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:54.513417 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60608ed5-a8bc-4987-ba52-cf2226c31694 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:55.058585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-60608ed5-a8bc-4987-ba52-cf2226c31694 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:55.071080 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-60608ed5-a8bc-4987-ba52-cf2226c31694 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.581956 Jun 02 16:33:55.080961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 765/1762] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:54 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:56.090176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c4862e86-6a91-4a31-949b-78b42ecc091b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:56.091840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c4862e86-6a91-4a31-949b-78b42ecc091b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:56.101258 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4862e86-6a91-4a31-949b-78b42ecc091b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:56.114682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4862e86-6a91-4a31-949b-78b42ecc091b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:56.114682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4862e86-6a91-4a31-949b-78b42ecc091b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:56.114682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4862e86-6a91-4a31-949b-78b42ecc091b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:56.392999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c4862e86-6a91-4a31-949b-78b42ecc091b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:56.401953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c4862e86-6a91-4a31-949b-78b42ecc091b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.316875 Jun 02 16:33:56.411323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 998/1763] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:56 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:56.724281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b14a03a7-c2e4-4ead-821d-a52c6ac5cfa6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Action: 'create', calling method: .version_select at 0x7f2d5c410280>, body: {"keypair": {"name": "tempest-keypair-927997917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlV3+q2AMDEw5UfjussNk6M6yE9kyqfNtVYp/cORAIW18eBuOxTAUIF57JiWQGPU08ct4j2Ej7GEp2JzBP9yWVz9G7iW9UaOtBA5VCl5O6rwzGBMZs2Wkp6RW0nCYmFnw=="}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:33:56.740108 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-b14a03a7-c2e4-4ead-821d-a52c6ac5cfa6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for project 17568d6be8f640359bd4c6ec666ea168. Resources: {'key_pairs'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:33:56.744605 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-b14a03a7-c2e4-4ead-821d-a52c6ac5cfa6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for user f8503989cb4a4d9c8db260b403e07226 and project 17568d6be8f640359bd4c6ec666ea168. Resources: {'key_pairs'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:33:56.835151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b14a03a7-c2e4-4ead-821d-a52c6ac5cfa6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.248804 Jun 02 16:33:56.835793 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 766/1764] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 2 16:33:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:33:57.439086 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4c0a5aaf-deeb-4aee-9234-7521b5ed4652 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:57.440962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4c0a5aaf-deeb-4aee-9234-7521b5ed4652 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:57.447663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c0a5aaf-deeb-4aee-9234-7521b5ed4652 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:57.448116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c0a5aaf-deeb-4aee-9234-7521b5ed4652 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:57.449179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c0a5aaf-deeb-4aee-9234-7521b5ed4652 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:57.449573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c0a5aaf-deeb-4aee-9234-7521b5ed4652 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:57.629439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4c0a5aaf-deeb-4aee-9234-7521b5ed4652 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:57.643289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4c0a5aaf-deeb-4aee-9234-7521b5ed4652 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.208661 Jun 02 16:33:57.644003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 999/1765] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:57 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:58.663148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-67b63d3f-441b-4051-bb88-4d508a32eaba tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:58.666260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-67b63d3f-441b-4051-bb88-4d508a32eaba tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:58.677497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67b63d3f-441b-4051-bb88-4d508a32eaba tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:58.677962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67b63d3f-441b-4051-bb88-4d508a32eaba tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:58.680333 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67b63d3f-441b-4051-bb88-4d508a32eaba tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:58.680774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-67b63d3f-441b-4051-bb88-4d508a32eaba tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:58.867100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-67b63d3f-441b-4051-bb88-4d508a32eaba tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:33:58.875535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-67b63d3f-441b-4051-bb88-4d508a32eaba tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.217908 Jun 02 16:33:58.885824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 767/1766] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:58 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:33:59.428018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1525703350", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c27844a7-dad1-4504-8943-6ba2accd51fc"}], "security_groups": [{"name": "tempest-securitygroup--1110094615"}], "key_name": "tempest-keypair-927997917", "user_data": "}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:33:59.532834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.network.neutron [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] validate_networks() for [('c27844a7-dad1-4504-8943-6ba2accd51fc', None, None, None, None, None)] {{(pid=118256) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:33:59.892881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-84d20426-7bea-4c72-b98a-5e9cdfae3391 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:33:59.893834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-84d20426-7bea-4c72-b98a-5e9cdfae3391 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:33:59.900709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84d20426-7bea-4c72-b98a-5e9cdfae3391 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:59.903535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84d20426-7bea-4c72-b98a-5e9cdfae3391 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:33:59.903535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84d20426-7bea-4c72-b98a-5e9cdfae3391 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:33:59.903535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84d20426-7bea-4c72-b98a-5e9cdfae3391 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:00.083958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-84d20426-7bea-4c72-b98a-5e9cdfae3391 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:00.095805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-84d20426-7bea-4c72-b98a-5e9cdfae3391 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.206482 Jun 02 16:34:00.105584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 768/1767] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:33:59 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:34:00.352225 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Flavor limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:34:00.352652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Image limits 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:34:00.353126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Flavor pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:34:00.353535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Image pref 0:0:0 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:34:00.353947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.virt.hardware [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:34:00.363536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:00.363995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:00.364801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:00.365478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:00.384562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for project 17568d6be8f640359bd4c6ec666ea168. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:34:00.388014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for user f8503989cb4a4d9c8db260b403e07226 and project 17568d6be8f640359bd4c6ec666ea168. Resources: {'ram', 'instances', 'cores'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:34:00.400115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Going to run 1 instances... {{(pid=118256) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:34:00.402435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:34:00.553321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e98ef5ac-c44e-477d-aac5-9b3965d3d15b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.131674 Jun 02 16:34:00.554673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1000/1768] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:33:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:34:00.564549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4c8a5a7d-c1f6-4eab-8644-0ffc60a159fb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:00.565697 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4c8a5a7d-c1f6-4eab-8644-0ffc60a159fb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:00.624049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4c8a5a7d-c1f6-4eab-8644-0ffc60a159fb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:00.631991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4c8a5a7d-c1f6-4eab-8644-0ffc60a159fb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1241 microversion: 2.1 time: 0.071662 Jun 02 16:34:00.641089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 769/1769] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:00 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:01.113414 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-723ea5fd-a4d5-4771-ad6c-30813e8f4acf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:01.114060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-723ea5fd-a4d5-4771-ad6c-30813e8f4acf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:01.120531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-723ea5fd-a4d5-4771-ad6c-30813e8f4acf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:01.120984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-723ea5fd-a4d5-4771-ad6c-30813e8f4acf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:01.121846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-723ea5fd-a4d5-4771-ad6c-30813e8f4acf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:01.122310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-723ea5fd-a4d5-4771-ad6c-30813e8f4acf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:01.272333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-723ea5fd-a4d5-4771-ad6c-30813e8f4acf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:01.280308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-723ea5fd-a4d5-4771-ad6c-30813e8f4acf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.170960 Jun 02 16:34:01.280871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1001/1770] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:01 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:01.648469 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-07a6a3c1-8ca5-4279-b14b-343a8f340072 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:01.649093 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-07a6a3c1-8ca5-4279-b14b-343a8f340072 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:01.707129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-07a6a3c1-8ca5-4279-b14b-343a8f340072 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:01.714838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-07a6a3c1-8ca5-4279-b14b-343a8f340072 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1241 microversion: 2.1 time: 0.070163 Jun 02 16:34:01.715389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 770/1771] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:01 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:02.297601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1a1f48fd-c0e7-4ff9-9a73-9ac73851c0a4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:02.298203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1a1f48fd-c0e7-4ff9-9a73-9ac73851c0a4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:02.304775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a1f48fd-c0e7-4ff9-9a73-9ac73851c0a4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:02.305233 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a1f48fd-c0e7-4ff9-9a73-9ac73851c0a4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:02.306000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a1f48fd-c0e7-4ff9-9a73-9ac73851c0a4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:02.306544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a1f48fd-c0e7-4ff9-9a73-9ac73851c0a4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:02.434696 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1a1f48fd-c0e7-4ff9-9a73-9ac73851c0a4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:02.442449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1a1f48fd-c0e7-4ff9-9a73-9ac73851c0a4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148852 Jun 02 16:34:02.443006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1002/1772] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:02 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:02.731643 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cd539db1-910f-4d97-a509-9f03c6c0eaf8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:02.732265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cd539db1-910f-4d97-a509-9f03c6c0eaf8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:02.738754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd539db1-910f-4d97-a509-9f03c6c0eaf8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:02.739193 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd539db1-910f-4d97-a509-9f03c6c0eaf8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:02.739954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd539db1-910f-4d97-a509-9f03c6c0eaf8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:02.740388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cd539db1-910f-4d97-a509-9f03c6c0eaf8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:02.836156 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cd539db1-910f-4d97-a509-9f03c6c0eaf8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:02.844063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cd539db1-910f-4d97-a509-9f03c6c0eaf8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1301 microversion: 2.1 time: 0.116229 Jun 02 16:34:02.844668 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 771/1773] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:02 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1301 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:03.460453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2717489a-b8ee-4b94-a44e-5a655e26b239 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:03.460952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2717489a-b8ee-4b94-a44e-5a655e26b239 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:03.467548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2717489a-b8ee-4b94-a44e-5a655e26b239 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:03.468003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2717489a-b8ee-4b94-a44e-5a655e26b239 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:03.468771 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2717489a-b8ee-4b94-a44e-5a655e26b239 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:03.469210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2717489a-b8ee-4b94-a44e-5a655e26b239 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:03.604477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2717489a-b8ee-4b94-a44e-5a655e26b239 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:03.619429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2717489a-b8ee-4b94-a44e-5a655e26b239 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.164193 Jun 02 16:34:03.620063 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1003/1774] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:03 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:03.860622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7ee8290a-ed39-44c0-9633-33fb8ab24ab4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:03.861273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7ee8290a-ed39-44c0-9633-33fb8ab24ab4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:03.868688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ee8290a-ed39-44c0-9633-33fb8ab24ab4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:03.869064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ee8290a-ed39-44c0-9633-33fb8ab24ab4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:03.869832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ee8290a-ed39-44c0-9633-33fb8ab24ab4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:03.871029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ee8290a-ed39-44c0-9633-33fb8ab24ab4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:04.124792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7ee8290a-ed39-44c0-9633-33fb8ab24ab4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:04.132290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7ee8290a-ed39-44c0-9633-33fb8ab24ab4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1367 microversion: 2.1 time: 0.275490 Jun 02 16:34:04.132942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 772/1775] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:03 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:04.635946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fc78a7a2-de5e-4f43-9776-4ead98b7364a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:04.637150 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fc78a7a2-de5e-4f43-9776-4ead98b7364a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:04.650892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fc78a7a2-de5e-4f43-9776-4ead98b7364a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:04.650892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fc78a7a2-de5e-4f43-9776-4ead98b7364a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:04.650892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fc78a7a2-de5e-4f43-9776-4ead98b7364a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:04.650892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fc78a7a2-de5e-4f43-9776-4ead98b7364a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:04.814772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-e0f23c4e-da4e-4fe3-936d-66ae347961e6 req-8e9119fe-f633-4f2c-971c-49a525f73cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3494b94-2b58-405b-8dfe-ddcbf9083330", "tag": "54aef804-7280-4ada-a448-162d8dd21bb2"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:34:04.824611 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e0f23c4e-da4e-4fe3-936d-66ae347961e6 req-8e9119fe-f633-4f2c-971c-49a525f73cd5 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:04.825294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e0f23c4e-da4e-4fe3-936d-66ae347961e6 req-8e9119fe-f633-4f2c-971c-49a525f73cd5 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:04.828525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fc78a7a2-de5e-4f43-9776-4ead98b7364a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:04.837775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fc78a7a2-de5e-4f43-9776-4ead98b7364a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.205629 Jun 02 16:34:04.838020 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-e0f23c4e-da4e-4fe3-936d-66ae347961e6 req-8e9119fe-f633-4f2c-971c-49a525f73cd5 service nova] Creating event network-changed:54aef804-7280-4ada-a448-162d8dd21bb2 for instance a3494b94-2b58-405b-8dfe-ddcbf9083330 on hv-cinder-79760 Jun 02 16:34:04.838421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1004/1776] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:04 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:04.843830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-e0f23c4e-da4e-4fe3-936d-66ae347961e6 req-8e9119fe-f633-4f2c-971c-49a525f73cd5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195096 Jun 02 16:34:04.844667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 773/1777] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:34:05.153941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e049f45e-cd03-4315-a454-676db45f6139 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:05.154777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e049f45e-cd03-4315-a454-676db45f6139 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:05.161528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e049f45e-cd03-4315-a454-676db45f6139 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:05.162005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e049f45e-cd03-4315-a454-676db45f6139 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:05.162806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e049f45e-cd03-4315-a454-676db45f6139 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:05.163244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e049f45e-cd03-4315-a454-676db45f6139 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:05.296890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e049f45e-cd03-4315-a454-676db45f6139 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:05.304336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e049f45e-cd03-4315-a454-676db45f6139 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1367 microversion: 2.1 time: 0.158729 Jun 02 16:34:05.304896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1005/1778] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:05 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:05.856657 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-aeac9619-0788-44ef-88d3-0d05b9e0b0d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:05.857349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-aeac9619-0788-44ef-88d3-0d05b9e0b0d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:05.863533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aeac9619-0788-44ef-88d3-0d05b9e0b0d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:05.863970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aeac9619-0788-44ef-88d3-0d05b9e0b0d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:05.864725 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aeac9619-0788-44ef-88d3-0d05b9e0b0d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:05.865154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-aeac9619-0788-44ef-88d3-0d05b9e0b0d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:05.998470 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-aeac9619-0788-44ef-88d3-0d05b9e0b0d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:06.007077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-aeac9619-0788-44ef-88d3-0d05b9e0b0d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.155092 Jun 02 16:34:06.007645 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 774/1779] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:05 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:06.321296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-86219835-76c5-40d2-99b0-6674369ece1f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:06.321915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-86219835-76c5-40d2-99b0-6674369ece1f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:06.328418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86219835-76c5-40d2-99b0-6674369ece1f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:06.328871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86219835-76c5-40d2-99b0-6674369ece1f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:06.329644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86219835-76c5-40d2-99b0-6674369ece1f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:06.330105 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-86219835-76c5-40d2-99b0-6674369ece1f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:06.460370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-86219835-76c5-40d2-99b0-6674369ece1f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:06.467869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-86219835-76c5-40d2-99b0-6674369ece1f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1367 microversion: 2.1 time: 0.150517 Jun 02 16:34:06.468425 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1006/1780] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:06 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:07.025346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-654555eb-7a0f-48bf-a932-0e1be94cf387 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:07.025948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-654555eb-7a0f-48bf-a932-0e1be94cf387 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:07.034142 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-654555eb-7a0f-48bf-a932-0e1be94cf387 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:07.035108 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-654555eb-7a0f-48bf-a932-0e1be94cf387 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:07.035862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-654555eb-7a0f-48bf-a932-0e1be94cf387 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:07.036292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-654555eb-7a0f-48bf-a932-0e1be94cf387 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:07.167512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-654555eb-7a0f-48bf-a932-0e1be94cf387 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:07.175739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-654555eb-7a0f-48bf-a932-0e1be94cf387 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154112 Jun 02 16:34:07.176303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 775/1781] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:07 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:07.484920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-864bd81f-8d84-48aa-ad94-85f1e1f2dedd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:07.485684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-864bd81f-8d84-48aa-ad94-85f1e1f2dedd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:07.492888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-864bd81f-8d84-48aa-ad94-85f1e1f2dedd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:07.493341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-864bd81f-8d84-48aa-ad94-85f1e1f2dedd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:07.494149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-864bd81f-8d84-48aa-ad94-85f1e1f2dedd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:07.494591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-864bd81f-8d84-48aa-ad94-85f1e1f2dedd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:07.499526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:07.624744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-864bd81f-8d84-48aa-ad94-85f1e1f2dedd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:07.633292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-864bd81f-8d84-48aa-ad94-85f1e1f2dedd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1367 microversion: 2.1 time: 0.152287 Jun 02 16:34:07.633836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1007/1782] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:07 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:34:08.193395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d3e82646-6fcc-4911-bc67-e59f0ad716ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:08.194161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d3e82646-6fcc-4911-bc67-e59f0ad716ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:08.200661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3e82646-6fcc-4911-bc67-e59f0ad716ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:08.201111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3e82646-6fcc-4911-bc67-e59f0ad716ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:08.201875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3e82646-6fcc-4911-bc67-e59f0ad716ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:08.202344 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3e82646-6fcc-4911-bc67-e59f0ad716ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:08.331219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d3e82646-6fcc-4911-bc67-e59f0ad716ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:08.339200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d3e82646-6fcc-4911-bc67-e59f0ad716ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150262 Jun 02 16:34:08.340049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 776/1783] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:08 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:08.650459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-04ebf6f7-4afb-4e9d-93ee-084199e2fa52 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:08.651080 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-04ebf6f7-4afb-4e9d-93ee-084199e2fa52 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:08.657766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04ebf6f7-4afb-4e9d-93ee-084199e2fa52 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:08.658376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04ebf6f7-4afb-4e9d-93ee-084199e2fa52 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:08.660291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04ebf6f7-4afb-4e9d-93ee-084199e2fa52 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:08.660813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04ebf6f7-4afb-4e9d-93ee-084199e2fa52 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:08.794495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-04ebf6f7-4afb-4e9d-93ee-084199e2fa52 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:08.802695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-04ebf6f7-4afb-4e9d-93ee-084199e2fa52 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1367 microversion: 2.1 time: 0.156264 Jun 02 16:34:08.803664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1008/1784] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:08 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:09.356316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bff7289c-7046-4907-b00d-dec43c893ee7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:09.356940 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bff7289c-7046-4907-b00d-dec43c893ee7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:09.364050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff7289c-7046-4907-b00d-dec43c893ee7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:09.364503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff7289c-7046-4907-b00d-dec43c893ee7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:09.365272 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff7289c-7046-4907-b00d-dec43c893ee7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:09.365714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bff7289c-7046-4907-b00d-dec43c893ee7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:09.492633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bff7289c-7046-4907-b00d-dec43c893ee7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:09.500685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bff7289c-7046-4907-b00d-dec43c893ee7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148193 Jun 02 16:34:09.501482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 777/1785] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:09 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:09.820165 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a35e5fb1-9f0f-468a-aa11-7cfbbfd77633 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:09.820787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a35e5fb1-9f0f-468a-aa11-7cfbbfd77633 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:09.827267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a35e5fb1-9f0f-468a-aa11-7cfbbfd77633 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:09.827719 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a35e5fb1-9f0f-468a-aa11-7cfbbfd77633 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:09.828490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a35e5fb1-9f0f-468a-aa11-7cfbbfd77633 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:09.828928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a35e5fb1-9f0f-468a-aa11-7cfbbfd77633 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:09.965136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a35e5fb1-9f0f-468a-aa11-7cfbbfd77633 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:09.972637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a35e5fb1-9f0f-468a-aa11-7cfbbfd77633 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1367 microversion: 2.1 time: 0.156375 Jun 02 16:34:09.973229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1009/1786] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:09 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:10.518712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c64f534d-0ff6-4c55-a88d-2026e5f5c303 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:10.519550 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c64f534d-0ff6-4c55-a88d-2026e5f5c303 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:10.526137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c64f534d-0ff6-4c55-a88d-2026e5f5c303 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:10.526588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c64f534d-0ff6-4c55-a88d-2026e5f5c303 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:10.527350 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c64f534d-0ff6-4c55-a88d-2026e5f5c303 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:10.527784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c64f534d-0ff6-4c55-a88d-2026e5f5c303 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:10.663944 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c64f534d-0ff6-4c55-a88d-2026e5f5c303 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:10.672302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c64f534d-0ff6-4c55-a88d-2026e5f5c303 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.157502 Jun 02 16:34:10.673007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 778/1787] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:10 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:10.690552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:10.692466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=6 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:10.751733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-4d77578d-cf99-4ba5-a961-75be69e7a008 req-0d4f9c04-a507-44d4-99c4-85dcd28f888d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3494b94-2b58-405b-8dfe-ddcbf9083330", "name": "network-vif-plugged", "status": "completed", "tag": "54aef804-7280-4ada-a448-162d8dd21bb2"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:34:10.761399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-4d77578d-cf99-4ba5-a961-75be69e7a008 req-0d4f9c04-a507-44d4-99c4-85dcd28f888d service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:10.761873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-4d77578d-cf99-4ba5-a961-75be69e7a008 req-0d4f9c04-a507-44d4-99c4-85dcd28f888d service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:10.772749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-4d77578d-cf99-4ba5-a961-75be69e7a008 req-0d4f9c04-a507-44d4-99c4-85dcd28f888d service nova] Creating event network-vif-plugged:54aef804-7280-4ada-a448-162d8dd21bb2 for instance a3494b94-2b58-405b-8dfe-ddcbf9083330 on hv-cinder-79760 Jun 02 16:34:10.777704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-4d77578d-cf99-4ba5-a961-75be69e7a008 req-0d4f9c04-a507-44d4-99c4-85dcd28f888d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091708 Jun 02 16:34:10.778333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1010/1788] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:34:10.989420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b67b259b-0fcc-4a18-abce-fa50b36ad7eb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:10.990034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b67b259b-0fcc-4a18-abce-fa50b36ad7eb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:10.996113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b67b259b-0fcc-4a18-abce-fa50b36ad7eb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:10.996562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b67b259b-0fcc-4a18-abce-fa50b36ad7eb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:10.997322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b67b259b-0fcc-4a18-abce-fa50b36ad7eb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:10.997762 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b67b259b-0fcc-4a18-abce-fa50b36ad7eb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:11.171141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b67b259b-0fcc-4a18-abce-fa50b36ad7eb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:11.179722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b67b259b-0fcc-4a18-abce-fa50b36ad7eb tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1367 microversion: 2.1 time: 0.194798 Jun 02 16:34:11.180317 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 779/1789] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:10 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:11.691765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c705ecd4-c476-45fa-9ec0-79d3b87f680b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:11.692499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c705ecd4-c476-45fa-9ec0-79d3b87f680b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:11.699906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c705ecd4-c476-45fa-9ec0-79d3b87f680b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:11.700356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c705ecd4-c476-45fa-9ec0-79d3b87f680b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:11.701127 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c705ecd4-c476-45fa-9ec0-79d3b87f680b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:11.701565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c705ecd4-c476-45fa-9ec0-79d3b87f680b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:11.845161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c705ecd4-c476-45fa-9ec0-79d3b87f680b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:11.853272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c705ecd4-c476-45fa-9ec0-79d3b87f680b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.167001 Jun 02 16:34:11.853837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1011/1790] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:11 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:12.197239 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3826e5b4-7263-47e5-b385-5c28b5b2d73c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:12.197854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3826e5b4-7263-47e5-b385-5c28b5b2d73c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:12.200317 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=8 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:12.205194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3826e5b4-7263-47e5-b385-5c28b5b2d73c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:12.205663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3826e5b4-7263-47e5-b385-5c28b5b2d73c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:12.206457 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3826e5b4-7263-47e5-b385-5c28b5b2d73c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:12.206895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3826e5b4-7263-47e5-b385-5c28b5b2d73c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:12.338510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3826e5b4-7263-47e5-b385-5c28b5b2d73c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:12.342168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:12.346886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3826e5b4-7263-47e5-b385-5c28b5b2d73c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1367 microversion: 2.1 time: 0.152992 Jun 02 16:34:12.347576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 780/1791] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:12 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:12.870516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dc728046-1dc3-4890-8170-7d1da5ef64ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:12.871070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dc728046-1dc3-4890-8170-7d1da5ef64ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:12.873474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:12.878206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc728046-1dc3-4890-8170-7d1da5ef64ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:12.878673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc728046-1dc3-4890-8170-7d1da5ef64ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:12.879415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc728046-1dc3-4890-8170-7d1da5ef64ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:12.879851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc728046-1dc3-4890-8170-7d1da5ef64ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:13.017295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-dc728046-1dc3-4890-8170-7d1da5ef64ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:13.024772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dc728046-1dc3-4890-8170-7d1da5ef64ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.158157 Jun 02 16:34:13.025339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1012/1792] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:12 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:13.364389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-21e00231-c7f0-4342-9fab-7f4ad145b34b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:13.364991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-21e00231-c7f0-4342-9fab-7f4ad145b34b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:13.367299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:13.372390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21e00231-c7f0-4342-9fab-7f4ad145b34b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:13.372872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21e00231-c7f0-4342-9fab-7f4ad145b34b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:13.376971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21e00231-c7f0-4342-9fab-7f4ad145b34b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:13.376971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21e00231-c7f0-4342-9fab-7f4ad145b34b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:13.508002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-21e00231-c7f0-4342-9fab-7f4ad145b34b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:13.515547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-21e00231-c7f0-4342-9fab-7f4ad145b34b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1557 microversion: 2.1 time: 0.155715 Jun 02 16:34:13.516114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 781/1793] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:13 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:13.532649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8c94fc79-829a-4cf0-9f68-7446bd0fc0c1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:13.533156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8c94fc79-829a-4cf0-9f68-7446bd0fc0c1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:13.539666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c94fc79-829a-4cf0-9f68-7446bd0fc0c1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:13.540120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c94fc79-829a-4cf0-9f68-7446bd0fc0c1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:13.540894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c94fc79-829a-4cf0-9f68-7446bd0fc0c1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:13.541328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8c94fc79-829a-4cf0-9f68-7446bd0fc0c1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:13.617588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8c94fc79-829a-4cf0-9f68-7446bd0fc0c1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088707 Jun 02 16:34:13.618275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1013/1794] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 2 16:34:13 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:34:14.042985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8a2765d0-1bd9-4575-8e3a-1bb265cdebcc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:14.043828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8a2765d0-1bd9-4575-8e3a-1bb265cdebcc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:14.049854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a2765d0-1bd9-4575-8e3a-1bb265cdebcc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:14.050491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a2765d0-1bd9-4575-8e3a-1bb265cdebcc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:14.051298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a2765d0-1bd9-4575-8e3a-1bb265cdebcc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:14.051733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a2765d0-1bd9-4575-8e3a-1bb265cdebcc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:14.520282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8a2765d0-1bd9-4575-8e3a-1bb265cdebcc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:14.528179 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8a2765d0-1bd9-4575-8e3a-1bb265cdebcc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.489187 Jun 02 16:34:14.528731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 782/1795] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:14 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:14.876864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-f25d00b4-ab81-42f8-80ee-315f32275309 req-d9937897-3519-4148-ab33-aabcba936494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3494b94-2b58-405b-8dfe-ddcbf9083330", "tag": "54aef804-7280-4ada-a448-162d8dd21bb2"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:34:14.886357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-f25d00b4-ab81-42f8-80ee-315f32275309 req-d9937897-3519-4148-ab33-aabcba936494 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:14.886357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-f25d00b4-ab81-42f8-80ee-315f32275309 req-d9937897-3519-4148-ab33-aabcba936494 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:14.897552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-f25d00b4-ab81-42f8-80ee-315f32275309 req-d9937897-3519-4148-ab33-aabcba936494 service nova] Creating event network-changed:54aef804-7280-4ada-a448-162d8dd21bb2 for instance a3494b94-2b58-405b-8dfe-ddcbf9083330 on hv-cinder-79760 Jun 02 16:34:14.903002 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-f25d00b4-ab81-42f8-80ee-315f32275309 req-d9937897-3519-4148-ab33-aabcba936494 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029824 Jun 02 16:34:14.903639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1014/1796] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:34:15.546116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f6231b9d-9a94-4596-827f-ff2a2f24a822 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:15.546945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f6231b9d-9a94-4596-827f-ff2a2f24a822 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:15.554836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6231b9d-9a94-4596-827f-ff2a2f24a822 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:15.555291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6231b9d-9a94-4596-827f-ff2a2f24a822 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:15.556077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6231b9d-9a94-4596-827f-ff2a2f24a822 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:15.556518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6231b9d-9a94-4596-827f-ff2a2f24a822 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:15.697786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f6231b9d-9a94-4596-827f-ff2a2f24a822 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:15.706155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f6231b9d-9a94-4596-827f-ff2a2f24a822 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.164244 Jun 02 16:34:15.707433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 783/1797] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:15 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:16.726984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f258917e-4874-49fc-b1c9-26c53d6a3115 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:16.727692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f258917e-4874-49fc-b1c9-26c53d6a3115 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:16.733981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f258917e-4874-49fc-b1c9-26c53d6a3115 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:16.734534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f258917e-4874-49fc-b1c9-26c53d6a3115 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:16.735310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f258917e-4874-49fc-b1c9-26c53d6a3115 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:16.735752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f258917e-4874-49fc-b1c9-26c53d6a3115 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:16.864611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f258917e-4874-49fc-b1c9-26c53d6a3115 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:16.872527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f258917e-4874-49fc-b1c9-26c53d6a3115 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151402 Jun 02 16:34:16.873080 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1015/1798] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:16 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:17.890722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cf35292d-75c0-4a21-8424-d731010ede2c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:17.891412 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cf35292d-75c0-4a21-8424-d731010ede2c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:17.898882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf35292d-75c0-4a21-8424-d731010ede2c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:17.909260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf35292d-75c0-4a21-8424-d731010ede2c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:17.909260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf35292d-75c0-4a21-8424-d731010ede2c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:17.909260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cf35292d-75c0-4a21-8424-d731010ede2c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:18.028874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cf35292d-75c0-4a21-8424-d731010ede2c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:18.037217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cf35292d-75c0-4a21-8424-d731010ede2c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150349 Jun 02 16:34:18.037788 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 784/1799] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:17 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:19.055328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7003c87c-0544-4f98-b58f-2211d97c8520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:19.055911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7003c87c-0544-4f98-b58f-2211d97c8520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:19.062390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7003c87c-0544-4f98-b58f-2211d97c8520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:19.062862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7003c87c-0544-4f98-b58f-2211d97c8520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:19.063627 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7003c87c-0544-4f98-b58f-2211d97c8520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:19.064064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7003c87c-0544-4f98-b58f-2211d97c8520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:19.197652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7003c87c-0544-4f98-b58f-2211d97c8520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:19.205607 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7003c87c-0544-4f98-b58f-2211d97c8520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154570 Jun 02 16:34:19.206190 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1016/1800] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:19 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:20.224126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-24c73063-9307-4b23-8ef7-e1a998b09cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:20.224791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-24c73063-9307-4b23-8ef7-e1a998b09cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:20.231464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24c73063-9307-4b23-8ef7-e1a998b09cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:20.232039 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24c73063-9307-4b23-8ef7-e1a998b09cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:20.232810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24c73063-9307-4b23-8ef7-e1a998b09cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:20.233239 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24c73063-9307-4b23-8ef7-e1a998b09cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:20.363704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-24c73063-9307-4b23-8ef7-e1a998b09cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:20.371864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-24c73063-9307-4b23-8ef7-e1a998b09cc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152375 Jun 02 16:34:20.372446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 785/1801] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:20 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:21.388643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3b74a26c-8b67-476b-8338-e6c91449628f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:21.389246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3b74a26c-8b67-476b-8338-e6c91449628f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:21.396495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b74a26c-8b67-476b-8338-e6c91449628f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:21.396946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b74a26c-8b67-476b-8338-e6c91449628f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:21.397716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b74a26c-8b67-476b-8338-e6c91449628f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:21.398176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b74a26c-8b67-476b-8338-e6c91449628f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:21.526538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3b74a26c-8b67-476b-8338-e6c91449628f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:21.534596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3b74a26c-8b67-476b-8338-e6c91449628f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149721 Jun 02 16:34:21.535155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1017/1802] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:21 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:22.552486 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-21e25452-6968-4efc-9584-848a25659acc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:22.553055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-21e25452-6968-4efc-9584-848a25659acc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:22.559575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21e25452-6968-4efc-9584-848a25659acc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:22.560022 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21e25452-6968-4efc-9584-848a25659acc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:22.560783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21e25452-6968-4efc-9584-848a25659acc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:22.561221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-21e25452-6968-4efc-9584-848a25659acc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:22.691965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-21e25452-6968-4efc-9584-848a25659acc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:22.700606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-21e25452-6968-4efc-9584-848a25659acc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152593 Jun 02 16:34:22.701188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 786/1803] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:22 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:23.718388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0c7b1f49-282c-475f-9fc1-595216f37550 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:23.718995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0c7b1f49-282c-475f-9fc1-595216f37550 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:23.725703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c7b1f49-282c-475f-9fc1-595216f37550 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:23.726176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c7b1f49-282c-475f-9fc1-595216f37550 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:23.726927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c7b1f49-282c-475f-9fc1-595216f37550 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:23.727356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c7b1f49-282c-475f-9fc1-595216f37550 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:23.857096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0c7b1f49-282c-475f-9fc1-595216f37550 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:23.865133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0c7b1f49-282c-475f-9fc1-595216f37550 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150878 Jun 02 16:34:23.865694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1018/1804] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:23 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:24.881964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-14cb350e-7ca2-427a-86c3-370628098ad2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:24.882551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-14cb350e-7ca2-427a-86c3-370628098ad2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:24.889062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14cb350e-7ca2-427a-86c3-370628098ad2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:24.889513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14cb350e-7ca2-427a-86c3-370628098ad2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:24.890308 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14cb350e-7ca2-427a-86c3-370628098ad2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:24.890748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14cb350e-7ca2-427a-86c3-370628098ad2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:25.020737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-14cb350e-7ca2-427a-86c3-370628098ad2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:25.028684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-14cb350e-7ca2-427a-86c3-370628098ad2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151106 Jun 02 16:34:25.029252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 787/1805] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:24 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:26.047156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f92ad813-079d-4900-9fee-4a98a1b5bfc7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:26.047734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f92ad813-079d-4900-9fee-4a98a1b5bfc7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:26.054847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f92ad813-079d-4900-9fee-4a98a1b5bfc7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:26.055292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f92ad813-079d-4900-9fee-4a98a1b5bfc7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:26.056053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f92ad813-079d-4900-9fee-4a98a1b5bfc7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:26.056486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f92ad813-079d-4900-9fee-4a98a1b5bfc7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:26.188140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f92ad813-079d-4900-9fee-4a98a1b5bfc7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:26.196198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f92ad813-079d-4900-9fee-4a98a1b5bfc7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152954 Jun 02 16:34:26.196771 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1019/1806] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:26 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:27.213446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-dcf1ce4a-17c1-4470-8faf-e60d8314456d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:27.213990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-dcf1ce4a-17c1-4470-8faf-e60d8314456d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:27.220892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dcf1ce4a-17c1-4470-8faf-e60d8314456d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:27.221341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dcf1ce4a-17c1-4470-8faf-e60d8314456d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:27.222877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dcf1ce4a-17c1-4470-8faf-e60d8314456d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:27.223812 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dcf1ce4a-17c1-4470-8faf-e60d8314456d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:27.360856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-dcf1ce4a-17c1-4470-8faf-e60d8314456d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:27.369357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-dcf1ce4a-17c1-4470-8faf-e60d8314456d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.159470 Jun 02 16:34:27.369566 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 788/1807] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:27 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:28.386567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f001cfab-a627-46b6-b7a4-53a61f6e6029 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:28.387198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f001cfab-a627-46b6-b7a4-53a61f6e6029 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:28.393545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f001cfab-a627-46b6-b7a4-53a61f6e6029 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:28.394708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f001cfab-a627-46b6-b7a4-53a61f6e6029 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:28.395468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f001cfab-a627-46b6-b7a4-53a61f6e6029 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:28.395902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f001cfab-a627-46b6-b7a4-53a61f6e6029 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:28.521340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f001cfab-a627-46b6-b7a4-53a61f6e6029 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:28.529120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f001cfab-a627-46b6-b7a4-53a61f6e6029 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.146453 Jun 02 16:34:28.529677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1020/1808] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:28 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:29.546241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cfff9db0-20e6-4645-b520-9a1daa163967 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:29.546836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cfff9db0-20e6-4645-b520-9a1daa163967 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:29.553285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfff9db0-20e6-4645-b520-9a1daa163967 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:29.553728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfff9db0-20e6-4645-b520-9a1daa163967 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:29.554520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfff9db0-20e6-4645-b520-9a1daa163967 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:29.554991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfff9db0-20e6-4645-b520-9a1daa163967 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:29.684346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cfff9db0-20e6-4645-b520-9a1daa163967 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:29.692971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cfff9db0-20e6-4645-b520-9a1daa163967 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150625 Jun 02 16:34:29.693542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 789/1809] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:29 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:30.709592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-51b1cef9-be38-4afc-809a-fab7848711f8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:30.710244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-51b1cef9-be38-4afc-809a-fab7848711f8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:30.717149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51b1cef9-be38-4afc-809a-fab7848711f8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:30.717596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51b1cef9-be38-4afc-809a-fab7848711f8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:30.718401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51b1cef9-be38-4afc-809a-fab7848711f8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:30.718839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-51b1cef9-be38-4afc-809a-fab7848711f8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:30.850671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-51b1cef9-be38-4afc-809a-fab7848711f8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:30.858557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-51b1cef9-be38-4afc-809a-fab7848711f8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152957 Jun 02 16:34:30.859123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1021/1810] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:30 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:31.876293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-793da6e6-93c3-441f-90b9-e68ef84333d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:31.876943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-793da6e6-93c3-441f-90b9-e68ef84333d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:31.883499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-793da6e6-93c3-441f-90b9-e68ef84333d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:31.885702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-793da6e6-93c3-441f-90b9-e68ef84333d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:31.885702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-793da6e6-93c3-441f-90b9-e68ef84333d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:31.885702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-793da6e6-93c3-441f-90b9-e68ef84333d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:32.013581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-793da6e6-93c3-441f-90b9-e68ef84333d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:32.021932 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-793da6e6-93c3-441f-90b9-e68ef84333d9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149627 Jun 02 16:34:32.022533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 790/1811] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:31 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:33.039461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3def8724-eac7-44ff-bf31-63192708444b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:33.040079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3def8724-eac7-44ff-bf31-63192708444b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:33.046526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3def8724-eac7-44ff-bf31-63192708444b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:33.046977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3def8724-eac7-44ff-bf31-63192708444b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:33.047742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3def8724-eac7-44ff-bf31-63192708444b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:33.048183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3def8724-eac7-44ff-bf31-63192708444b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:33.174410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3def8724-eac7-44ff-bf31-63192708444b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:33.182986 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3def8724-eac7-44ff-bf31-63192708444b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.147417 Jun 02 16:34:33.183556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1022/1812] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:33 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:34.201048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a536643f-1563-445d-804a-f57744cb94a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:34.201706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a536643f-1563-445d-804a-f57744cb94a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:34.209005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a536643f-1563-445d-804a-f57744cb94a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:34.209453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a536643f-1563-445d-804a-f57744cb94a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:34.210249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a536643f-1563-445d-804a-f57744cb94a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:34.210695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a536643f-1563-445d-804a-f57744cb94a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:34.341887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a536643f-1563-445d-804a-f57744cb94a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:34.349986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a536643f-1563-445d-804a-f57744cb94a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152837 Jun 02 16:34:34.350582 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 791/1813] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:34 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:35.366418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-16a9ddf3-8356-4e55-bb1a-4f829a13b17a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:35.366978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-16a9ddf3-8356-4e55-bb1a-4f829a13b17a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:35.373513 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16a9ddf3-8356-4e55-bb1a-4f829a13b17a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:35.373963 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16a9ddf3-8356-4e55-bb1a-4f829a13b17a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:35.374755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16a9ddf3-8356-4e55-bb1a-4f829a13b17a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:35.375189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16a9ddf3-8356-4e55-bb1a-4f829a13b17a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:35.505354 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-16a9ddf3-8356-4e55-bb1a-4f829a13b17a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:35.513243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-16a9ddf3-8356-4e55-bb1a-4f829a13b17a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150897 Jun 02 16:34:35.513801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1023/1814] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:35 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:36.530743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2b2f496e-5300-4932-ad5c-a215c3e15021 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:36.531294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2b2f496e-5300-4932-ad5c-a215c3e15021 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:36.538329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b2f496e-5300-4932-ad5c-a215c3e15021 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:36.538781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b2f496e-5300-4932-ad5c-a215c3e15021 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:36.539547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b2f496e-5300-4932-ad5c-a215c3e15021 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:36.539980 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b2f496e-5300-4932-ad5c-a215c3e15021 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:36.668451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2b2f496e-5300-4932-ad5c-a215c3e15021 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:36.677286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2b2f496e-5300-4932-ad5c-a215c3e15021 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150472 Jun 02 16:34:36.677853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 792/1815] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:36 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:37.693610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4f8a48e6-1ce1-4192-bf73-f9a3811ade80 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:37.694274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4f8a48e6-1ce1-4192-bf73-f9a3811ade80 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:37.700789 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4f8a48e6-1ce1-4192-bf73-f9a3811ade80 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:37.701243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4f8a48e6-1ce1-4192-bf73-f9a3811ade80 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:37.702016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4f8a48e6-1ce1-4192-bf73-f9a3811ade80 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:37.702504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4f8a48e6-1ce1-4192-bf73-f9a3811ade80 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:37.707236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=91 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:37.833868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4f8a48e6-1ce1-4192-bf73-f9a3811ade80 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:37.842528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4f8a48e6-1ce1-4192-bf73-f9a3811ade80 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152784 Jun 02 16:34:37.843096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1024/1816] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:37 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:38.859606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1caba3d2-8e0f-4dbd-9001-ca3f5198df42 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:38.860228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1caba3d2-8e0f-4dbd-9001-ca3f5198df42 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:38.867299 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1caba3d2-8e0f-4dbd-9001-ca3f5198df42 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:38.867742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1caba3d2-8e0f-4dbd-9001-ca3f5198df42 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:38.868499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1caba3d2-8e0f-4dbd-9001-ca3f5198df42 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:38.868926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1caba3d2-8e0f-4dbd-9001-ca3f5198df42 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:38.999049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1caba3d2-8e0f-4dbd-9001-ca3f5198df42 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:39.007503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1caba3d2-8e0f-4dbd-9001-ca3f5198df42 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151783 Jun 02 16:34:39.008062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 793/1817] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:38 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:40.024879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0f62c443-85a4-489b-ba40-4d10886d6346 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:40.025487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0f62c443-85a4-489b-ba40-4d10886d6346 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:40.031929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f62c443-85a4-489b-ba40-4d10886d6346 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:40.032379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f62c443-85a4-489b-ba40-4d10886d6346 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:40.033140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f62c443-85a4-489b-ba40-4d10886d6346 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:40.034262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f62c443-85a4-489b-ba40-4d10886d6346 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:40.163731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0f62c443-85a4-489b-ba40-4d10886d6346 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:40.171752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0f62c443-85a4-489b-ba40-4d10886d6346 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150667 Jun 02 16:34:40.172533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1025/1818] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:40 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:41.188498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a9928866-45a2-4899-ac00-6533119334d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:41.189111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a9928866-45a2-4899-ac00-6533119334d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:41.196238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9928866-45a2-4899-ac00-6533119334d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:41.196678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9928866-45a2-4899-ac00-6533119334d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:41.197434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9928866-45a2-4899-ac00-6533119334d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:41.197865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a9928866-45a2-4899-ac00-6533119334d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:41.328419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a9928866-45a2-4899-ac00-6533119334d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:41.336863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a9928866-45a2-4899-ac00-6533119334d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152223 Jun 02 16:34:41.337434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 794/1819] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:41 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:42.353698 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-067a1b7a-7996-486e-90ea-901c38db8993 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:42.354340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-067a1b7a-7996-486e-90ea-901c38db8993 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:42.360822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-067a1b7a-7996-486e-90ea-901c38db8993 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:42.361271 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-067a1b7a-7996-486e-90ea-901c38db8993 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:42.362631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-067a1b7a-7996-486e-90ea-901c38db8993 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:42.363064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-067a1b7a-7996-486e-90ea-901c38db8993 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:42.492439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-067a1b7a-7996-486e-90ea-901c38db8993 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:42.500244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-067a1b7a-7996-486e-90ea-901c38db8993 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150385 Jun 02 16:34:42.500808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1026/1820] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:42 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:43.516659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-901c3269-3086-47ee-a6c5-43ad69e29f5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:43.517274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-901c3269-3086-47ee-a6c5-43ad69e29f5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:43.520121 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:43.524998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-901c3269-3086-47ee-a6c5-43ad69e29f5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:43.525446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-901c3269-3086-47ee-a6c5-43ad69e29f5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:43.526249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-901c3269-3086-47ee-a6c5-43ad69e29f5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:43.526689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-901c3269-3086-47ee-a6c5-43ad69e29f5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:43.530635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=85 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:43.657927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-901c3269-3086-47ee-a6c5-43ad69e29f5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:43.667327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-901c3269-3086-47ee-a6c5-43ad69e29f5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154538 Jun 02 16:34:43.667904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 795/1821] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:43 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:44.684530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-04b6e886-9f81-4261-bd00-06d72fcdf799 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:44.685134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-04b6e886-9f81-4261-bd00-06d72fcdf799 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:44.687157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=30 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:34:44.692432 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04b6e886-9f81-4261-bd00-06d72fcdf799 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:44.692902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04b6e886-9f81-4261-bd00-06d72fcdf799 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:44.693632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04b6e886-9f81-4261-bd00-06d72fcdf799 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:44.694058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-04b6e886-9f81-4261-bd00-06d72fcdf799 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:44.822647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-04b6e886-9f81-4261-bd00-06d72fcdf799 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:44.831304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-04b6e886-9f81-4261-bd00-06d72fcdf799 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149757 Jun 02 16:34:44.831947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1027/1822] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:44 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:45.849249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-91e65932-f73a-4b82-bae6-31d387fb8c70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:45.849854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-91e65932-f73a-4b82-bae6-31d387fb8c70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:45.856109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91e65932-f73a-4b82-bae6-31d387fb8c70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:45.856608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91e65932-f73a-4b82-bae6-31d387fb8c70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:45.857364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91e65932-f73a-4b82-bae6-31d387fb8c70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:45.857795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-91e65932-f73a-4b82-bae6-31d387fb8c70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:45.987257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-91e65932-f73a-4b82-bae6-31d387fb8c70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:45.995269 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-91e65932-f73a-4b82-bae6-31d387fb8c70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150502 Jun 02 16:34:45.995828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 796/1823] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:45 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:47.012274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-12f3550d-0fda-4bbc-b766-e4982ab36538 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:47.012925 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-12f3550d-0fda-4bbc-b766-e4982ab36538 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:47.019770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12f3550d-0fda-4bbc-b766-e4982ab36538 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:47.020224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12f3550d-0fda-4bbc-b766-e4982ab36538 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:47.020990 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12f3550d-0fda-4bbc-b766-e4982ab36538 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:47.021431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12f3550d-0fda-4bbc-b766-e4982ab36538 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:47.151753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-12f3550d-0fda-4bbc-b766-e4982ab36538 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:47.160163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-12f3550d-0fda-4bbc-b766-e4982ab36538 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151793 Jun 02 16:34:47.160724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1028/1824] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:47 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:48.177817 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e54664b2-ecd4-40dd-96be-ac8ca448dc7d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:48.178462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e54664b2-ecd4-40dd-96be-ac8ca448dc7d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:48.185428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e54664b2-ecd4-40dd-96be-ac8ca448dc7d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:48.185875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e54664b2-ecd4-40dd-96be-ac8ca448dc7d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:48.186672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e54664b2-ecd4-40dd-96be-ac8ca448dc7d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:48.187117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e54664b2-ecd4-40dd-96be-ac8ca448dc7d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:48.317150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e54664b2-ecd4-40dd-96be-ac8ca448dc7d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:48.325204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e54664b2-ecd4-40dd-96be-ac8ca448dc7d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151934 Jun 02 16:34:48.325805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 797/1825] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:48 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:49.342875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-630d847f-9d2a-471c-bade-e192416d2d5d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:49.343519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-630d847f-9d2a-471c-bade-e192416d2d5d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:49.349864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-630d847f-9d2a-471c-bade-e192416d2d5d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:49.350352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-630d847f-9d2a-471c-bade-e192416d2d5d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:49.351115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-630d847f-9d2a-471c-bade-e192416d2d5d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:49.351547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-630d847f-9d2a-471c-bade-e192416d2d5d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:49.480104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-630d847f-9d2a-471c-bade-e192416d2d5d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:49.489146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-630d847f-9d2a-471c-bade-e192416d2d5d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150401 Jun 02 16:34:49.489723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1029/1826] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:49 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:50.507376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-96bae996-3f01-4bb5-8fb9-553c5076bb9b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:50.507948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-96bae996-3f01-4bb5-8fb9-553c5076bb9b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:50.514585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96bae996-3f01-4bb5-8fb9-553c5076bb9b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:50.515897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96bae996-3f01-4bb5-8fb9-553c5076bb9b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:50.515897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96bae996-3f01-4bb5-8fb9-553c5076bb9b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:50.516225 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-96bae996-3f01-4bb5-8fb9-553c5076bb9b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:50.647831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-96bae996-3f01-4bb5-8fb9-553c5076bb9b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:50.655795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-96bae996-3f01-4bb5-8fb9-553c5076bb9b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152457 Jun 02 16:34:50.656357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 798/1827] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:50 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:51.674383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-36417cd5-1bd8-4f7b-9804-51b0dcb500da tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:51.674997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-36417cd5-1bd8-4f7b-9804-51b0dcb500da tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:51.681482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36417cd5-1bd8-4f7b-9804-51b0dcb500da tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:51.681872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36417cd5-1bd8-4f7b-9804-51b0dcb500da tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:51.682706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36417cd5-1bd8-4f7b-9804-51b0dcb500da tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:51.683144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36417cd5-1bd8-4f7b-9804-51b0dcb500da tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:51.817411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-36417cd5-1bd8-4f7b-9804-51b0dcb500da tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:51.825417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-36417cd5-1bd8-4f7b-9804-51b0dcb500da tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.155466 Jun 02 16:34:51.825987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1030/1828] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:51 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:52.843284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-17b2143e-9e10-4b5f-95af-ad10536b9e20 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:52.843892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-17b2143e-9e10-4b5f-95af-ad10536b9e20 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:52.850475 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-17b2143e-9e10-4b5f-95af-ad10536b9e20 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:52.850928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-17b2143e-9e10-4b5f-95af-ad10536b9e20 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:52.851686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-17b2143e-9e10-4b5f-95af-ad10536b9e20 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:52.852118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-17b2143e-9e10-4b5f-95af-ad10536b9e20 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:52.981023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-17b2143e-9e10-4b5f-95af-ad10536b9e20 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:52.989123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-17b2143e-9e10-4b5f-95af-ad10536b9e20 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150173 Jun 02 16:34:52.989684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 799/1829] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:52 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:54.006412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4ff2d5e0-c407-4b88-91cc-dc81a466a606 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:54.007008 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4ff2d5e0-c407-4b88-91cc-dc81a466a606 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:54.013359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4ff2d5e0-c407-4b88-91cc-dc81a466a606 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:54.013800 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4ff2d5e0-c407-4b88-91cc-dc81a466a606 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:54.014585 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4ff2d5e0-c407-4b88-91cc-dc81a466a606 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:54.015018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4ff2d5e0-c407-4b88-91cc-dc81a466a606 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:54.140963 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4ff2d5e0-c407-4b88-91cc-dc81a466a606 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:54.149660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4ff2d5e0-c407-4b88-91cc-dc81a466a606 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.147096 Jun 02 16:34:54.150258 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1031/1830] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:54 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:34:55.167261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ce21fa55-662f-42af-8b46-85e99ececeaa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:55.168103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ce21fa55-662f-42af-8b46-85e99ececeaa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:55.175471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce21fa55-662f-42af-8b46-85e99ececeaa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:55.175926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce21fa55-662f-42af-8b46-85e99ececeaa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:55.176703 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce21fa55-662f-42af-8b46-85e99ececeaa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:55.177140 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce21fa55-662f-42af-8b46-85e99ececeaa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:55.309121 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ce21fa55-662f-42af-8b46-85e99ececeaa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:55.317235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ce21fa55-662f-42af-8b46-85e99ececeaa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153929 Jun 02 16:34:55.317796 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 800/1831] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:55 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:56.334908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a11f1916-d4ad-4fe3-bb6e-573deb66cfc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:56.335521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a11f1916-d4ad-4fe3-bb6e-573deb66cfc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:56.342455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a11f1916-d4ad-4fe3-bb6e-573deb66cfc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:56.342909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a11f1916-d4ad-4fe3-bb6e-573deb66cfc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:56.343686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a11f1916-d4ad-4fe3-bb6e-573deb66cfc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:56.344157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a11f1916-d4ad-4fe3-bb6e-573deb66cfc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:56.472740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a11f1916-d4ad-4fe3-bb6e-573deb66cfc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:56.481905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a11f1916-d4ad-4fe3-bb6e-573deb66cfc0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150803 Jun 02 16:34:56.482548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1032/1832] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:56 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:57.499091 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-63972736-3f1f-4f80-a9a5-fea59a79c7ca tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:57.499734 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-63972736-3f1f-4f80-a9a5-fea59a79c7ca tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:57.506745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63972736-3f1f-4f80-a9a5-fea59a79c7ca tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:57.507201 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63972736-3f1f-4f80-a9a5-fea59a79c7ca tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:57.507970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63972736-3f1f-4f80-a9a5-fea59a79c7ca tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:57.508412 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-63972736-3f1f-4f80-a9a5-fea59a79c7ca tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:57.639240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-63972736-3f1f-4f80-a9a5-fea59a79c7ca tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:57.647443 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-63972736-3f1f-4f80-a9a5-fea59a79c7ca tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152249 Jun 02 16:34:57.648555 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 801/1833] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:57 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:58.664468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6d6617ef-8543-4d88-8d08-f9420e29a38c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:58.665049 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6d6617ef-8543-4d88-8d08-f9420e29a38c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:58.671666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d6617ef-8543-4d88-8d08-f9420e29a38c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:58.672108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d6617ef-8543-4d88-8d08-f9420e29a38c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:58.672864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d6617ef-8543-4d88-8d08-f9420e29a38c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:58.673939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d6617ef-8543-4d88-8d08-f9420e29a38c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:58.811014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6d6617ef-8543-4d88-8d08-f9420e29a38c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:58.820177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6d6617ef-8543-4d88-8d08-f9420e29a38c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.159698 Jun 02 16:34:58.820746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1033/1834] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:58 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:34:59.837701 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e2ab4582-90dd-4e69-a21d-baa897ffb787 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:34:59.838337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e2ab4582-90dd-4e69-a21d-baa897ffb787 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:34:59.845052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2ab4582-90dd-4e69-a21d-baa897ffb787 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:59.845493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2ab4582-90dd-4e69-a21d-baa897ffb787 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:59.846273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2ab4582-90dd-4e69-a21d-baa897ffb787 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:34:59.846708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e2ab4582-90dd-4e69-a21d-baa897ffb787 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:34:59.977147 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e2ab4582-90dd-4e69-a21d-baa897ffb787 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:34:59.985086 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e2ab4582-90dd-4e69-a21d-baa897ffb787 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151199 Jun 02 16:34:59.986267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 802/1835] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:34:59 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:01.003163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6a65f3fb-e416-4705-b5e3-000b3a34c603 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:01.003770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6a65f3fb-e416-4705-b5e3-000b3a34c603 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:01.010381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a65f3fb-e416-4705-b5e3-000b3a34c603 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:01.010883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a65f3fb-e416-4705-b5e3-000b3a34c603 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:01.011683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a65f3fb-e416-4705-b5e3-000b3a34c603 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:01.012198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a65f3fb-e416-4705-b5e3-000b3a34c603 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:01.139873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6a65f3fb-e416-4705-b5e3-000b3a34c603 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:01.148611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6a65f3fb-e416-4705-b5e3-000b3a34c603 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149728 Jun 02 16:35:01.149177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1034/1836] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:00 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:02.166285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-98d17c67-2148-445d-a367-708c680dc4af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:02.166849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-98d17c67-2148-445d-a367-708c680dc4af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:02.174002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98d17c67-2148-445d-a367-708c680dc4af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:02.174485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98d17c67-2148-445d-a367-708c680dc4af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:02.175249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98d17c67-2148-445d-a367-708c680dc4af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:02.175681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-98d17c67-2148-445d-a367-708c680dc4af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:02.306233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-98d17c67-2148-445d-a367-708c680dc4af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:02.314000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-98d17c67-2148-445d-a367-708c680dc4af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151750 Jun 02 16:35:02.314575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 803/1837] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:02 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:03.331974 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c57f4e89-8419-4ce9-9f71-9a0eb25d39f7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:03.332539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c57f4e89-8419-4ce9-9f71-9a0eb25d39f7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:03.339240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c57f4e89-8419-4ce9-9f71-9a0eb25d39f7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:03.339685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c57f4e89-8419-4ce9-9f71-9a0eb25d39f7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:03.340446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c57f4e89-8419-4ce9-9f71-9a0eb25d39f7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:03.340879 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c57f4e89-8419-4ce9-9f71-9a0eb25d39f7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:03.468563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c57f4e89-8419-4ce9-9f71-9a0eb25d39f7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:03.477392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c57f4e89-8419-4ce9-9f71-9a0eb25d39f7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149924 Jun 02 16:35:03.477953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1035/1838] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:03 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:04.494538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-637ba6eb-b184-480d-a2c0-3cced82eaedb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:04.495191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-637ba6eb-b184-480d-a2c0-3cced82eaedb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:04.502420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-637ba6eb-b184-480d-a2c0-3cced82eaedb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:04.502873 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-637ba6eb-b184-480d-a2c0-3cced82eaedb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:04.503642 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-637ba6eb-b184-480d-a2c0-3cced82eaedb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:04.504079 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-637ba6eb-b184-480d-a2c0-3cced82eaedb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:04.631996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-637ba6eb-b184-480d-a2c0-3cced82eaedb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:04.639946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-637ba6eb-b184-480d-a2c0-3cced82eaedb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149264 Jun 02 16:35:04.640515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 804/1839] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:04 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:05.656757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0a6430f6-15f6-406a-9b7f-f3f7198b7b5e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:05.657421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0a6430f6-15f6-406a-9b7f-f3f7198b7b5e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:05.664104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a6430f6-15f6-406a-9b7f-f3f7198b7b5e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:05.664558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a6430f6-15f6-406a-9b7f-f3f7198b7b5e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:05.665315 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a6430f6-15f6-406a-9b7f-f3f7198b7b5e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:05.665752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0a6430f6-15f6-406a-9b7f-f3f7198b7b5e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:05.795333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0a6430f6-15f6-406a-9b7f-f3f7198b7b5e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:05.803424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0a6430f6-15f6-406a-9b7f-f3f7198b7b5e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150533 Jun 02 16:35:05.804135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1036/1840] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:05 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:06.180313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:35:06.180735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:35:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:35:06.820534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6c7c9e09-aaad-48f9-b784-2d053cd2c3d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:06.821177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6c7c9e09-aaad-48f9-b784-2d053cd2c3d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:06.827692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6c7c9e09-aaad-48f9-b784-2d053cd2c3d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:06.828136 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6c7c9e09-aaad-48f9-b784-2d053cd2c3d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:06.828886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6c7c9e09-aaad-48f9-b784-2d053cd2c3d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:06.829319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6c7c9e09-aaad-48f9-b784-2d053cd2c3d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:06.961712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6c7c9e09-aaad-48f9-b784-2d053cd2c3d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:06.970440 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6c7c9e09-aaad-48f9-b784-2d053cd2c3d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153274 Jun 02 16:35:06.971006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 805/1841] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:06 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:07.988006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2f9a7a26-98e8-4cf1-a221-b9464028b631 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:07.988610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2f9a7a26-98e8-4cf1-a221-b9464028b631 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:07.994957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a26-98e8-4cf1-a221-b9464028b631 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:07.995411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a26-98e8-4cf1-a221-b9464028b631 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:07.996172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a26-98e8-4cf1-a221-b9464028b631 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:07.996608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2f9a7a26-98e8-4cf1-a221-b9464028b631 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:07.999252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=78 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:35:08.127391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2f9a7a26-98e8-4cf1-a221-b9464028b631 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:08.135212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2f9a7a26-98e8-4cf1-a221-b9464028b631 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151901 Jun 02 16:35:08.135772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1037/1842] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:07 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:09.152426 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f15f0fbd-e683-414b-9620-5b3958d8698c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:09.153006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f15f0fbd-e683-414b-9620-5b3958d8698c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:09.159641 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f15f0fbd-e683-414b-9620-5b3958d8698c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:09.160087 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f15f0fbd-e683-414b-9620-5b3958d8698c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:09.160846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f15f0fbd-e683-414b-9620-5b3958d8698c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:09.161282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f15f0fbd-e683-414b-9620-5b3958d8698c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:09.289828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f15f0fbd-e683-414b-9620-5b3958d8698c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:09.298644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f15f0fbd-e683-414b-9620-5b3958d8698c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149271 Jun 02 16:35:09.299232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 806/1843] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:09 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:10.317147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-77b799fb-0b76-4ac8-9594-b74f9cc4e2a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:10.320970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-77b799fb-0b76-4ac8-9594-b74f9cc4e2a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:10.324459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77b799fb-0b76-4ac8-9594-b74f9cc4e2a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:10.324914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77b799fb-0b76-4ac8-9594-b74f9cc4e2a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:10.325667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77b799fb-0b76-4ac8-9594-b74f9cc4e2a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:10.326135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77b799fb-0b76-4ac8-9594-b74f9cc4e2a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:10.455175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-77b799fb-0b76-4ac8-9594-b74f9cc4e2a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:10.462992 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-77b799fb-0b76-4ac8-9594-b74f9cc4e2a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150213 Jun 02 16:35:10.463548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1038/1844] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:10 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:11.480027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9c8205d4-5045-48a3-a495-817d89378ddc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:11.480635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9c8205d4-5045-48a3-a495-817d89378ddc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:11.487416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c8205d4-5045-48a3-a495-817d89378ddc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:11.487860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c8205d4-5045-48a3-a495-817d89378ddc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:11.488627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c8205d4-5045-48a3-a495-817d89378ddc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:11.489060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c8205d4-5045-48a3-a495-817d89378ddc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:11.626271 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9c8205d4-5045-48a3-a495-817d89378ddc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:11.634376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9c8205d4-5045-48a3-a495-817d89378ddc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.158122 Jun 02 16:35:11.634937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 807/1845] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:11 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:12.651568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5e88c145-1d61-4b8c-af21-c62b40988a23 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:12.666112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5e88c145-1d61-4b8c-af21-c62b40988a23 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:12.666112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e88c145-1d61-4b8c-af21-c62b40988a23 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:12.666112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e88c145-1d61-4b8c-af21-c62b40988a23 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:12.666112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e88c145-1d61-4b8c-af21-c62b40988a23 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:12.666538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e88c145-1d61-4b8c-af21-c62b40988a23 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:12.792919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5e88c145-1d61-4b8c-af21-c62b40988a23 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:12.800985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5e88c145-1d61-4b8c-af21-c62b40988a23 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153344 Jun 02 16:35:12.801545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1039/1846] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:12 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:13.818414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7e097b2e-3e4a-4e19-ade1-f44543305b97 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:13.818962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7e097b2e-3e4a-4e19-ade1-f44543305b97 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:13.821288 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=26 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:35:13.825951 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e097b2e-3e4a-4e19-ade1-f44543305b97 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:13.826420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e097b2e-3e4a-4e19-ade1-f44543305b97 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:13.827174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e097b2e-3e4a-4e19-ade1-f44543305b97 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:13.827631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7e097b2e-3e4a-4e19-ade1-f44543305b97 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:13.830353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=78 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:35:13.958866 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7e097b2e-3e4a-4e19-ade1-f44543305b97 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:13.966918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7e097b2e-3e4a-4e19-ade1-f44543305b97 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152471 Jun 02 16:35:13.967471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 808/1847] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:13 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:35:14.984209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-944eb923-bc83-4b81-992e-76caa734b9cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:14.985350 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-944eb923-bc83-4b81-992e-76caa734b9cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:14.987347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=26 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:35:14.992023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-944eb923-bc83-4b81-992e-76caa734b9cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:14.992473 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-944eb923-bc83-4b81-992e-76caa734b9cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:14.993219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-944eb923-bc83-4b81-992e-76caa734b9cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:14.993646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-944eb923-bc83-4b81-992e-76caa734b9cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:15.124345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-944eb923-bc83-4b81-992e-76caa734b9cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:15.132242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-944eb923-bc83-4b81-992e-76caa734b9cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151839 Jun 02 16:35:15.132796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1040/1848] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:14 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:16.150414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a5a806ce-bbb0-40d9-8dbe-f403921d8999 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:16.151023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a5a806ce-bbb0-40d9-8dbe-f403921d8999 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:16.157658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5a806ce-bbb0-40d9-8dbe-f403921d8999 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:16.158116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5a806ce-bbb0-40d9-8dbe-f403921d8999 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:16.158875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5a806ce-bbb0-40d9-8dbe-f403921d8999 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:16.159303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5a806ce-bbb0-40d9-8dbe-f403921d8999 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:16.288061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a5a806ce-bbb0-40d9-8dbe-f403921d8999 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:16.295879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a5a806ce-bbb0-40d9-8dbe-f403921d8999 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149303 Jun 02 16:35:16.296442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 809/1849] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:16 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:17.314036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-175b1240-2dad-4c8d-adc1-86c6b7d1bf2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:17.314585 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-175b1240-2dad-4c8d-adc1-86c6b7d1bf2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:17.321080 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-175b1240-2dad-4c8d-adc1-86c6b7d1bf2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:17.321527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-175b1240-2dad-4c8d-adc1-86c6b7d1bf2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:17.322316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-175b1240-2dad-4c8d-adc1-86c6b7d1bf2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:17.322754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-175b1240-2dad-4c8d-adc1-86c6b7d1bf2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:17.448720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-175b1240-2dad-4c8d-adc1-86c6b7d1bf2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:17.457560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-175b1240-2dad-4c8d-adc1-86c6b7d1bf2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148103 Jun 02 16:35:17.458153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1041/1850] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:17 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:18.476045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-77468bb5-2f50-418e-abc8-45a67d75f462 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:18.476605 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-77468bb5-2f50-418e-abc8-45a67d75f462 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:18.483061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77468bb5-2f50-418e-abc8-45a67d75f462 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:18.483513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77468bb5-2f50-418e-abc8-45a67d75f462 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:18.484291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77468bb5-2f50-418e-abc8-45a67d75f462 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:18.485453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-77468bb5-2f50-418e-abc8-45a67d75f462 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:18.615558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-77468bb5-2f50-418e-abc8-45a67d75f462 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:18.623500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-77468bb5-2f50-418e-abc8-45a67d75f462 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151436 Jun 02 16:35:18.624073 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 810/1851] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:18 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:19.641279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6343153c-c6a4-4555-ade8-0c9c859517cf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:19.641862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6343153c-c6a4-4555-ade8-0c9c859517cf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:19.648401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6343153c-c6a4-4555-ade8-0c9c859517cf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:19.648850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6343153c-c6a4-4555-ade8-0c9c859517cf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:19.649624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6343153c-c6a4-4555-ade8-0c9c859517cf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:19.650061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6343153c-c6a4-4555-ade8-0c9c859517cf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:19.786900 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6343153c-c6a4-4555-ade8-0c9c859517cf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:19.794787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6343153c-c6a4-4555-ade8-0c9c859517cf tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.158077 Jun 02 16:35:19.795351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1042/1852] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:19 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:20.813026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-de90f732-21f0-4f5f-8bf2-883b892c3d2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:20.813743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-de90f732-21f0-4f5f-8bf2-883b892c3d2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:20.820328 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de90f732-21f0-4f5f-8bf2-883b892c3d2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:20.820781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de90f732-21f0-4f5f-8bf2-883b892c3d2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:20.821552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de90f732-21f0-4f5f-8bf2-883b892c3d2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:20.821993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de90f732-21f0-4f5f-8bf2-883b892c3d2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:20.950181 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-de90f732-21f0-4f5f-8bf2-883b892c3d2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:20.958685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-de90f732-21f0-4f5f-8bf2-883b892c3d2f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150074 Jun 02 16:35:20.959255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 811/1853] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:20 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:21.976126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1a753a36-0b33-4975-b73e-cc0700e397ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:21.976890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1a753a36-0b33-4975-b73e-cc0700e397ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:21.983396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a753a36-0b33-4975-b73e-cc0700e397ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:21.983840 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a753a36-0b33-4975-b73e-cc0700e397ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:21.984621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a753a36-0b33-4975-b73e-cc0700e397ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:21.985362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1a753a36-0b33-4975-b73e-cc0700e397ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:22.111801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1a753a36-0b33-4975-b73e-cc0700e397ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:22.120038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1a753a36-0b33-4975-b73e-cc0700e397ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.147692 Jun 02 16:35:22.120599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1043/1854] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:21 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:23.137500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a5a8744e-f19b-449d-97fc-a6d4a394b5b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:23.138056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a5a8744e-f19b-449d-97fc-a6d4a394b5b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:23.145825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5a8744e-f19b-449d-97fc-a6d4a394b5b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:23.146313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5a8744e-f19b-449d-97fc-a6d4a394b5b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:23.147092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5a8744e-f19b-449d-97fc-a6d4a394b5b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:23.147532 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5a8744e-f19b-449d-97fc-a6d4a394b5b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:23.279507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a5a8744e-f19b-449d-97fc-a6d4a394b5b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:23.288309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a5a8744e-f19b-449d-97fc-a6d4a394b5b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154618 Jun 02 16:35:23.288869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 812/1855] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:23 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:24.305562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f31e0a71-5a5a-4ccc-975b-fc944b28ff8a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:24.306202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f31e0a71-5a5a-4ccc-975b-fc944b28ff8a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:24.313206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f31e0a71-5a5a-4ccc-975b-fc944b28ff8a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:24.313655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f31e0a71-5a5a-4ccc-975b-fc944b28ff8a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:24.314441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f31e0a71-5a5a-4ccc-975b-fc944b28ff8a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:24.314875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f31e0a71-5a5a-4ccc-975b-fc944b28ff8a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:24.442449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f31e0a71-5a5a-4ccc-975b-fc944b28ff8a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:24.450488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f31e0a71-5a5a-4ccc-975b-fc944b28ff8a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148742 Jun 02 16:35:24.451043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1044/1856] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:24 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:25.468918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f554795b-fd61-4d00-be5d-57860b0918be tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:25.469545 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f554795b-fd61-4d00-be5d-57860b0918be tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:25.476012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f554795b-fd61-4d00-be5d-57860b0918be tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:25.476454 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f554795b-fd61-4d00-be5d-57860b0918be tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:25.477214 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f554795b-fd61-4d00-be5d-57860b0918be tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:25.477644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f554795b-fd61-4d00-be5d-57860b0918be tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:25.607121 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f554795b-fd61-4d00-be5d-57860b0918be tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:25.615346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f554795b-fd61-4d00-be5d-57860b0918be tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150905 Jun 02 16:35:25.615922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 813/1857] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:25 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:26.632597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-337fc930-7b75-40a0-98af-170f853fd3e9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:26.633151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-337fc930-7b75-40a0-98af-170f853fd3e9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:26.639582 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-337fc930-7b75-40a0-98af-170f853fd3e9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:26.640045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-337fc930-7b75-40a0-98af-170f853fd3e9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:26.641604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-337fc930-7b75-40a0-98af-170f853fd3e9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:26.642033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-337fc930-7b75-40a0-98af-170f853fd3e9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:26.772596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-337fc930-7b75-40a0-98af-170f853fd3e9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:26.780410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-337fc930-7b75-40a0-98af-170f853fd3e9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151936 Jun 02 16:35:26.780987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1045/1858] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:26 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:27.796670 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-49f5b028-c2f3-49b3-abae-4798fbe275fb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:27.797278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-49f5b028-c2f3-49b3-abae-4798fbe275fb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:27.803716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-49f5b028-c2f3-49b3-abae-4798fbe275fb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:27.804168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-49f5b028-c2f3-49b3-abae-4798fbe275fb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:27.804920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-49f5b028-c2f3-49b3-abae-4798fbe275fb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:27.805351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-49f5b028-c2f3-49b3-abae-4798fbe275fb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:27.934276 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-49f5b028-c2f3-49b3-abae-4798fbe275fb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:27.942335 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-49f5b028-c2f3-49b3-abae-4798fbe275fb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149515 Jun 02 16:35:27.942917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 814/1859] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:27 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:28.959507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ce05821d-51d9-4e6c-a114-1bb76c2de23a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:28.960108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ce05821d-51d9-4e6c-a114-1bb76c2de23a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:28.966910 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce05821d-51d9-4e6c-a114-1bb76c2de23a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:28.967356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce05821d-51d9-4e6c-a114-1bb76c2de23a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:28.968609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce05821d-51d9-4e6c-a114-1bb76c2de23a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:28.969112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce05821d-51d9-4e6c-a114-1bb76c2de23a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:29.104928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ce05821d-51d9-4e6c-a114-1bb76c2de23a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:29.105306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ce05821d-51d9-4e6c-a114-1bb76c2de23a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149517 Jun 02 16:35:29.105866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1046/1860] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:28 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:30.067658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4dd7cfc1-0a99-489d-847e-9831971d90f5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:30.068246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4dd7cfc1-0a99-489d-847e-9831971d90f5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:30.074642 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4dd7cfc1-0a99-489d-847e-9831971d90f5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:30.075097 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4dd7cfc1-0a99-489d-847e-9831971d90f5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:30.075863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4dd7cfc1-0a99-489d-847e-9831971d90f5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:30.076306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4dd7cfc1-0a99-489d-847e-9831971d90f5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:30.099286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4dd7cfc1-0a99-489d-847e-9831971d90f5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330/ips" status: 200 len: 149 microversion: 2.1 time: 0.035509 Jun 02 16:35:30.099843 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 815/1861] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 2 16:35:30 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:35:30.122893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7acd3181-918f-4bdf-b575-c58de5194f56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:30.123516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7acd3181-918f-4bdf-b575-c58de5194f56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:30.131153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7acd3181-918f-4bdf-b575-c58de5194f56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:30.131606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7acd3181-918f-4bdf-b575-c58de5194f56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:30.132367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7acd3181-918f-4bdf-b575-c58de5194f56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:30.132806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7acd3181-918f-4bdf-b575-c58de5194f56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:30.271361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7acd3181-918f-4bdf-b575-c58de5194f56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:30.279338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7acd3181-918f-4bdf-b575-c58de5194f56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.160191 Jun 02 16:35:30.279890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1047/1862] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:30 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:31.298148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ddfbe86e-acb4-4d70-9bc2-3322aa4150ab tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:31.298760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ddfbe86e-acb4-4d70-9bc2-3322aa4150ab tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:31.305305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ddfbe86e-acb4-4d70-9bc2-3322aa4150ab tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:31.305751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ddfbe86e-acb4-4d70-9bc2-3322aa4150ab tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:31.306529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ddfbe86e-acb4-4d70-9bc2-3322aa4150ab tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:31.306961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ddfbe86e-acb4-4d70-9bc2-3322aa4150ab tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:31.440213 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ddfbe86e-acb4-4d70-9bc2-3322aa4150ab tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:31.448161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ddfbe86e-acb4-4d70-9bc2-3322aa4150ab tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154706 Jun 02 16:35:31.448735 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 816/1863] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:31 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:32.464931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-09a8dcb2-fbaf-46c7-8214-d098c6e0ab34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:32.465534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-09a8dcb2-fbaf-46c7-8214-d098c6e0ab34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:32.472842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09a8dcb2-fbaf-46c7-8214-d098c6e0ab34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:32.473283 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09a8dcb2-fbaf-46c7-8214-d098c6e0ab34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:32.474032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09a8dcb2-fbaf-46c7-8214-d098c6e0ab34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:32.474501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09a8dcb2-fbaf-46c7-8214-d098c6e0ab34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:32.599810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-09a8dcb2-fbaf-46c7-8214-d098c6e0ab34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:32.607616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-09a8dcb2-fbaf-46c7-8214-d098c6e0ab34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.146750 Jun 02 16:35:32.608157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1048/1864] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:32 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:33.624957 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a4ac54a5-044b-449d-9716-1e761c4802d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:33.625569 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a4ac54a5-044b-449d-9716-1e761c4802d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:33.632111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a5-044b-449d-9716-1e761c4802d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:33.632562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a5-044b-449d-9716-1e761c4802d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:33.633323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a5-044b-449d-9716-1e761c4802d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:33.633763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4ac54a5-044b-449d-9716-1e761c4802d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:33.762667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a4ac54a5-044b-449d-9716-1e761c4802d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:33.771055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a4ac54a5-044b-449d-9716-1e761c4802d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150141 Jun 02 16:35:33.771620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 817/1865] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:33 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:34.788501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a78d3070-bd07-424e-8c05-8b669f21425b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:34.789109 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a78d3070-bd07-424e-8c05-8b669f21425b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:34.795612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a78d3070-bd07-424e-8c05-8b669f21425b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:34.796122 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a78d3070-bd07-424e-8c05-8b669f21425b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:34.796886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a78d3070-bd07-424e-8c05-8b669f21425b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:34.797318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a78d3070-bd07-424e-8c05-8b669f21425b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:34.926609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a78d3070-bd07-424e-8c05-8b669f21425b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:34.934454 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a78d3070-bd07-424e-8c05-8b669f21425b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149770 Jun 02 16:35:34.935014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1049/1866] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:34 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:35.951484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cc37db4c-d25c-4c43-992b-d39195aabb82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:35.952131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cc37db4c-d25c-4c43-992b-d39195aabb82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:35.958765 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc37db4c-d25c-4c43-992b-d39195aabb82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:35.959205 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc37db4c-d25c-4c43-992b-d39195aabb82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:35.959965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc37db4c-d25c-4c43-992b-d39195aabb82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:35.960437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc37db4c-d25c-4c43-992b-d39195aabb82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:36.093742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cc37db4c-d25c-4c43-992b-d39195aabb82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:36.102022 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cc37db4c-d25c-4c43-992b-d39195aabb82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154505 Jun 02 16:35:36.102667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 818/1867] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:35 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:37.119249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-34ec5a19-f4fb-46db-89a3-7e6f57040c6d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:37.119892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-34ec5a19-f4fb-46db-89a3-7e6f57040c6d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:37.126378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34ec5a19-f4fb-46db-89a3-7e6f57040c6d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:37.126835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34ec5a19-f4fb-46db-89a3-7e6f57040c6d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:37.127588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34ec5a19-f4fb-46db-89a3-7e6f57040c6d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:37.128022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34ec5a19-f4fb-46db-89a3-7e6f57040c6d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:37.264140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-34ec5a19-f4fb-46db-89a3-7e6f57040c6d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:37.272272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-34ec5a19-f4fb-46db-89a3-7e6f57040c6d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.156907 Jun 02 16:35:37.272839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1050/1868] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:37 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:38.289549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8a6f9e5e-c3e3-41c5-a7c2-79b6f9253111 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:38.290280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8a6f9e5e-c3e3-41c5-a7c2-79b6f9253111 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:38.297461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a6f9e5e-c3e3-41c5-a7c2-79b6f9253111 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:38.297917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a6f9e5e-c3e3-41c5-a7c2-79b6f9253111 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:38.298711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a6f9e5e-c3e3-41c5-a7c2-79b6f9253111 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:38.299152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a6f9e5e-c3e3-41c5-a7c2-79b6f9253111 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:38.426709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8a6f9e5e-c3e3-41c5-a7c2-79b6f9253111 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:38.434637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8a6f9e5e-c3e3-41c5-a7c2-79b6f9253111 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148846 Jun 02 16:35:38.435209 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 819/1869] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:38 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:39.453030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d2ef777e-787f-4638-b08a-2043a4d0ef6b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:39.453655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d2ef777e-787f-4638-b08a-2043a4d0ef6b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:39.460203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2ef777e-787f-4638-b08a-2043a4d0ef6b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:39.460655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2ef777e-787f-4638-b08a-2043a4d0ef6b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:39.461445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2ef777e-787f-4638-b08a-2043a4d0ef6b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:39.461883 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2ef777e-787f-4638-b08a-2043a4d0ef6b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:39.464674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:35:39.591444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d2ef777e-787f-4638-b08a-2043a4d0ef6b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:39.599761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d2ef777e-787f-4638-b08a-2043a4d0ef6b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151480 Jun 02 16:35:39.600326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1051/1870] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:39 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:40.616941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8eafa094-fcf5-40c6-865a-676b25229b92 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:40.617496 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8eafa094-fcf5-40c6-865a-676b25229b92 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:40.624016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8eafa094-fcf5-40c6-865a-676b25229b92 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:40.624501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8eafa094-fcf5-40c6-865a-676b25229b92 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:40.625267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8eafa094-fcf5-40c6-865a-676b25229b92 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:40.625705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8eafa094-fcf5-40c6-865a-676b25229b92 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:40.789273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8eafa094-fcf5-40c6-865a-676b25229b92 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:40.797310 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8eafa094-fcf5-40c6-865a-676b25229b92 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.184493 Jun 02 16:35:40.797872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 820/1871] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:40 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:41.814957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c4b76d86-4f7f-42a1-8ba9-60adcc1950d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:41.815566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c4b76d86-4f7f-42a1-8ba9-60adcc1950d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:41.821909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4b76d86-4f7f-42a1-8ba9-60adcc1950d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:41.822362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4b76d86-4f7f-42a1-8ba9-60adcc1950d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:41.823119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4b76d86-4f7f-42a1-8ba9-60adcc1950d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:41.823549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c4b76d86-4f7f-42a1-8ba9-60adcc1950d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:41.961311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c4b76d86-4f7f-42a1-8ba9-60adcc1950d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:41.970053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c4b76d86-4f7f-42a1-8ba9-60adcc1950d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.159549 Jun 02 16:35:41.970642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1052/1872] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:41 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:42.542392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9c0c9952-15e8-4312-8e94-bc4c72e467d6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:42.543438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9c0c9952-15e8-4312-8e94-bc4c72e467d6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:42.550775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c0c9952-15e8-4312-8e94-bc4c72e467d6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:42.551224 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c0c9952-15e8-4312-8e94-bc4c72e467d6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:42.551992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c0c9952-15e8-4312-8e94-bc4c72e467d6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:42.552427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c0c9952-15e8-4312-8e94-bc4c72e467d6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:42.582542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9c0c9952-15e8-4312-8e94-bc4c72e467d6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Jun 02 16:35:42.583082 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 821/1873] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:35:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:35:42.640228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d8e38180-7f06-4306-bc48-45302c1f0df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:42.641856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d8e38180-7f06-4306-bc48-45302c1f0df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:42.646893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d8e38180-7f06-4306-bc48-45302c1f0df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:42.647343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d8e38180-7f06-4306-bc48-45302c1f0df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:42.648100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d8e38180-7f06-4306-bc48-45302c1f0df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:42.648534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d8e38180-7f06-4306-bc48-45302c1f0df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:42.673479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d8e38180-7f06-4306-bc48-45302c1f0df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:35:42.910981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d8e38180-7f06-4306-bc48-45302c1f0df9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 204 len: 0 microversion: 2.1 time: 0.274321 Jun 02 16:35:42.911642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1053/1874] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:35:42 2022] DELETE /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:35:42.919641 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5c348178-1bdb-4091-bf1d-fb336682e2a7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:42.920294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5c348178-1bdb-4091-bf1d-fb336682e2a7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:42.926507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c348178-1bdb-4091-bf1d-fb336682e2a7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:42.926962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c348178-1bdb-4091-bf1d-fb336682e2a7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:42.927729 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c348178-1bdb-4091-bf1d-fb336682e2a7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:42.928168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c348178-1bdb-4091-bf1d-fb336682e2a7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:42.987928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-64478cde-3989-4abc-ad8a-3fa6368de651 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:42.988623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-64478cde-3989-4abc-ad8a-3fa6368de651 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:42.994629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64478cde-3989-4abc-ad8a-3fa6368de651 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:42.995071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64478cde-3989-4abc-ad8a-3fa6368de651 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:42.995826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64478cde-3989-4abc-ad8a-3fa6368de651 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:42.996258 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-64478cde-3989-4abc-ad8a-3fa6368de651 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:43.058481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5c348178-1bdb-4091-bf1d-fb336682e2a7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:43.066994 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5c348178-1bdb-4091-bf1d-fb336682e2a7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1718 microversion: 2.1 time: 0.151256 Jun 02 16:35:43.067567 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 822/1875] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:43.127505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-64478cde-3989-4abc-ad8a-3fa6368de651 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:43.135477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-64478cde-3989-4abc-ad8a-3fa6368de651 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152188 Jun 02 16:35:43.136051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1054/1876] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:42 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:35:44.085451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-83f2dfac-4de2-4293-9ba4-61c61a10a5a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:44.086089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-83f2dfac-4de2-4293-9ba4-61c61a10a5a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:44.088639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=30 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:35:44.093970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83f2dfac-4de2-4293-9ba4-61c61a10a5a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:44.094446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83f2dfac-4de2-4293-9ba4-61c61a10a5a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:44.095217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83f2dfac-4de2-4293-9ba4-61c61a10a5a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:44.095654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83f2dfac-4de2-4293-9ba4-61c61a10a5a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:44.098307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=88 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:35:44.152899 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e687ec88-36d2-4cd6-8608-a0ae30cb47a1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:44.153496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e687ec88-36d2-4cd6-8608-a0ae30cb47a1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:44.160933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e687ec88-36d2-4cd6-8608-a0ae30cb47a1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:44.161377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e687ec88-36d2-4cd6-8608-a0ae30cb47a1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:44.162183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e687ec88-36d2-4cd6-8608-a0ae30cb47a1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:44.162620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e687ec88-36d2-4cd6-8608-a0ae30cb47a1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:44.295826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e687ec88-36d2-4cd6-8608-a0ae30cb47a1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:44.303777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e687ec88-36d2-4cd6-8608-a0ae30cb47a1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154784 Jun 02 16:35:44.304341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1055/1877] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:44 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:35:44.331193 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-83f2dfac-4de2-4293-9ba4-61c61a10a5a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:44.339676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-83f2dfac-4de2-4293-9ba4-61c61a10a5a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1718 microversion: 2.1 time: 0.258027 Jun 02 16:35:44.340247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 823/1878] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:44 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1718 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:45.003161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-51aba687-cee6-4f47-98b9-86fa6ac32fcd req-0d18421e-2be5-4f6d-814f-0fa7cad05c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d978fa-9abe-42e1-af29-1ccea22ff4c9", "name": "network-vif-deleted", "tag": "3ce4a557-9dd7-4f99-8a53-2bb41b1937c7"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:35:45.011965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-51aba687-cee6-4f47-98b9-86fa6ac32fcd req-0d18421e-2be5-4f6d-814f-0fa7cad05c1f service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:45.012488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-51aba687-cee6-4f47-98b9-86fa6ac32fcd req-0d18421e-2be5-4f6d-814f-0fa7cad05c1f service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:45.023884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-51aba687-cee6-4f47-98b9-86fa6ac32fcd req-0d18421e-2be5-4f6d-814f-0fa7cad05c1f service nova] Creating event network-vif-deleted:3ce4a557-9dd7-4f99-8a53-2bb41b1937c7 for instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 on hv-cinder-79760 Jun 02 16:35:45.029041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-51aba687-cee6-4f47-98b9-86fa6ac32fcd req-0d18421e-2be5-4f6d-814f-0fa7cad05c1f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032460 Jun 02 16:35:45.029709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1056/1879] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:35:45.320810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8b4193ed-74c8-42f3-ae4b-f953024c2fa1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:45.321441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8b4193ed-74c8-42f3-ae4b-f953024c2fa1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:45.328296 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b4193ed-74c8-42f3-ae4b-f953024c2fa1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:45.328828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b4193ed-74c8-42f3-ae4b-f953024c2fa1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:45.329690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b4193ed-74c8-42f3-ae4b-f953024c2fa1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:45.330306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8b4193ed-74c8-42f3-ae4b-f953024c2fa1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:45.357184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a1ed9ca0-d917-4e32-8490-23eb8a8bd204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:45.357947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a1ed9ca0-d917-4e32-8490-23eb8a8bd204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:45.360401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:35:45.365973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a1ed9ca0-d917-4e32-8490-23eb8a8bd204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:45.366768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a1ed9ca0-d917-4e32-8490-23eb8a8bd204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:45.367770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a1ed9ca0-d917-4e32-8490-23eb8a8bd204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:45.368402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a1ed9ca0-d917-4e32-8490-23eb8a8bd204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:45.434792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a1ed9ca0-d917-4e32-8490-23eb8a8bd204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:45.443803 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a1ed9ca0-d917-4e32-8490-23eb8a8bd204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.090797 Jun 02 16:35:45.450138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1057/1880] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:35:45.462965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8b4193ed-74c8-42f3-ae4b-f953024c2fa1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:45.471732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8b4193ed-74c8-42f3-ae4b-f953024c2fa1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154876 Jun 02 16:35:45.472300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 824/1881] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:45 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:46.461005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-557c124c-c4f4-409b-aba9-fbb1ce76bf0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:46.461619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-557c124c-c4f4-409b-aba9-fbb1ce76bf0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:46.468407 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-557c124c-c4f4-409b-aba9-fbb1ce76bf0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:46.468856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-557c124c-c4f4-409b-aba9-fbb1ce76bf0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:46.469617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-557c124c-c4f4-409b-aba9-fbb1ce76bf0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:46.470050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-557c124c-c4f4-409b-aba9-fbb1ce76bf0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:46.489204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6a4af7d0-0c4c-4575-93d6-8f0e27e75ec1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:46.489823 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6a4af7d0-0c4c-4575-93d6-8f0e27e75ec1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:46.496133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6a4af7d0-0c4c-4575-93d6-8f0e27e75ec1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:46.496585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6a4af7d0-0c4c-4575-93d6-8f0e27e75ec1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:46.497355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6a4af7d0-0c4c-4575-93d6-8f0e27e75ec1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:46.497791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6a4af7d0-0c4c-4575-93d6-8f0e27e75ec1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:46.530896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-557c124c-c4f4-409b-aba9-fbb1ce76bf0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:46.539060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-557c124c-c4f4-409b-aba9-fbb1ce76bf0b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081893 Jun 02 16:35:46.539765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1058/1882] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:46.630129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6a4af7d0-0c4c-4575-93d6-8f0e27e75ec1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:46.637869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6a4af7d0-0c4c-4575-93d6-8f0e27e75ec1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152579 Jun 02 16:35:46.638463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 825/1883] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:46 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:35:47.557031 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2e90ed8f-1116-4895-ae05-6d39063f22cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:47.557610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2e90ed8f-1116-4895-ae05-6d39063f22cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:47.565031 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e90ed8f-1116-4895-ae05-6d39063f22cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:47.565481 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e90ed8f-1116-4895-ae05-6d39063f22cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:47.566278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e90ed8f-1116-4895-ae05-6d39063f22cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:47.566715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2e90ed8f-1116-4895-ae05-6d39063f22cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:47.630106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2e90ed8f-1116-4895-ae05-6d39063f22cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:47.637920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2e90ed8f-1116-4895-ae05-6d39063f22cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084870 Jun 02 16:35:47.638516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1059/1884] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:47 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:47.654934 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-38c8fd17-a263-4610-85a9-b9f58856731f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:47.655613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-38c8fd17-a263-4610-85a9-b9f58856731f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:47.662133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38c8fd17-a263-4610-85a9-b9f58856731f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:47.664737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38c8fd17-a263-4610-85a9-b9f58856731f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:47.664737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38c8fd17-a263-4610-85a9-b9f58856731f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:47.664737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-38c8fd17-a263-4610-85a9-b9f58856731f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:47.789881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-38c8fd17-a263-4610-85a9-b9f58856731f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:47.797887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-38c8fd17-a263-4610-85a9-b9f58856731f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.146864 Jun 02 16:35:47.798485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 826/1885] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:47 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:48.659512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f9ba70e0-ec06-4da7-8dd9-5db5e9f4a233 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:48.659512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f9ba70e0-ec06-4da7-8dd9-5db5e9f4a233 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:48.663858 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9ba70e0-ec06-4da7-8dd9-5db5e9f4a233 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:48.664298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9ba70e0-ec06-4da7-8dd9-5db5e9f4a233 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:48.665047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9ba70e0-ec06-4da7-8dd9-5db5e9f4a233 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:48.665477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f9ba70e0-ec06-4da7-8dd9-5db5e9f4a233 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:48.730660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f9ba70e0-ec06-4da7-8dd9-5db5e9f4a233 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:48.739019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f9ba70e0-ec06-4da7-8dd9-5db5e9f4a233 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087052 Jun 02 16:35:48.739575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1060/1886] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:48 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:48.815315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0d85d441-8cec-4867-a332-1e65d8dba701 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:48.815931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0d85d441-8cec-4867-a332-1e65d8dba701 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:48.822601 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0d85d441-8cec-4867-a332-1e65d8dba701 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:48.823046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0d85d441-8cec-4867-a332-1e65d8dba701 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:48.823805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0d85d441-8cec-4867-a332-1e65d8dba701 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:48.824240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0d85d441-8cec-4867-a332-1e65d8dba701 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:48.957594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0d85d441-8cec-4867-a332-1e65d8dba701 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:48.965730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0d85d441-8cec-4867-a332-1e65d8dba701 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154794 Jun 02 16:35:48.966330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 827/1887] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:48 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:49.755807 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-addb5d2a-5b0e-4582-a71d-f7fdd6f07258 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:49.756368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-addb5d2a-5b0e-4582-a71d-f7fdd6f07258 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:49.762978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-addb5d2a-5b0e-4582-a71d-f7fdd6f07258 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:49.763429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-addb5d2a-5b0e-4582-a71d-f7fdd6f07258 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:49.764190 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-addb5d2a-5b0e-4582-a71d-f7fdd6f07258 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:49.764634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-addb5d2a-5b0e-4582-a71d-f7fdd6f07258 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:49.825344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-addb5d2a-5b0e-4582-a71d-f7fdd6f07258 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:49.833263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-addb5d2a-5b0e-4582-a71d-f7fdd6f07258 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081492 Jun 02 16:35:49.833824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1061/1888] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:35:49.983446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f6377374-e16d-4f06-a7cd-1fb11b8b30a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:49.984135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f6377374-e16d-4f06-a7cd-1fb11b8b30a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:49.993694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6377374-e16d-4f06-a7cd-1fb11b8b30a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:49.994166 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6377374-e16d-4f06-a7cd-1fb11b8b30a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:49.994927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6377374-e16d-4f06-a7cd-1fb11b8b30a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:49.995462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f6377374-e16d-4f06-a7cd-1fb11b8b30a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:50.126923 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f6377374-e16d-4f06-a7cd-1fb11b8b30a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:50.134882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f6377374-e16d-4f06-a7cd-1fb11b8b30a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.155289 Jun 02 16:35:50.135450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 828/1889] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:49 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:50.850467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-71d35247-8375-463e-a239-5e25e494a251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:50.851109 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-71d35247-8375-463e-a239-5e25e494a251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:50.857549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-71d35247-8375-463e-a239-5e25e494a251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:50.858006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-71d35247-8375-463e-a239-5e25e494a251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:50.859286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-71d35247-8375-463e-a239-5e25e494a251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:50.859729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-71d35247-8375-463e-a239-5e25e494a251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:50.920047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-71d35247-8375-463e-a239-5e25e494a251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:50.928847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-71d35247-8375-463e-a239-5e25e494a251 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082333 Jun 02 16:35:50.929402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1062/1890] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:51.152911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d7381beb-87c2-4631-8f16-335a91cc551a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:51.153543 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d7381beb-87c2-4631-8f16-335a91cc551a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:51.160240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7381beb-87c2-4631-8f16-335a91cc551a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:51.160684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7381beb-87c2-4631-8f16-335a91cc551a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:51.161449 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7381beb-87c2-4631-8f16-335a91cc551a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:51.161861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7381beb-87c2-4631-8f16-335a91cc551a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:51.294023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d7381beb-87c2-4631-8f16-335a91cc551a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:51.302935 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d7381beb-87c2-4631-8f16-335a91cc551a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154002 Jun 02 16:35:51.303508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 829/1891] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:51 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:51.946872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1fe37362-3e82-4336-b59b-b9cf8e262b1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:51.947506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1fe37362-3e82-4336-b59b-b9cf8e262b1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:51.953954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fe37362-3e82-4336-b59b-b9cf8e262b1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:51.954592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fe37362-3e82-4336-b59b-b9cf8e262b1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:51.955412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fe37362-3e82-4336-b59b-b9cf8e262b1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:51.955851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1fe37362-3e82-4336-b59b-b9cf8e262b1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:52.016301 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1fe37362-3e82-4336-b59b-b9cf8e262b1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:52.024169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1fe37362-3e82-4336-b59b-b9cf8e262b1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081172 Jun 02 16:35:52.024726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1063/1892] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:52.320372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fe7d64bd-89fa-43ef-a1b8-952d5466ddd9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:52.320899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fe7d64bd-89fa-43ef-a1b8-952d5466ddd9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:52.327391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe7d64bd-89fa-43ef-a1b8-952d5466ddd9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:52.327836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe7d64bd-89fa-43ef-a1b8-952d5466ddd9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:52.328605 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe7d64bd-89fa-43ef-a1b8-952d5466ddd9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:52.329050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe7d64bd-89fa-43ef-a1b8-952d5466ddd9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:52.719294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fe7d64bd-89fa-43ef-a1b8-952d5466ddd9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:52.727394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fe7d64bd-89fa-43ef-a1b8-952d5466ddd9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.410989 Jun 02 16:35:52.727964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 830/1893] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:52 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:35:53.040743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0ac6fdf9-6dc8-482d-b13c-7db4729dda72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:53.041358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0ac6fdf9-6dc8-482d-b13c-7db4729dda72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:53.048679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ac6fdf9-6dc8-482d-b13c-7db4729dda72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:53.049125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ac6fdf9-6dc8-482d-b13c-7db4729dda72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:53.049884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ac6fdf9-6dc8-482d-b13c-7db4729dda72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:53.050342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ac6fdf9-6dc8-482d-b13c-7db4729dda72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:53.113566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0ac6fdf9-6dc8-482d-b13c-7db4729dda72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:53.121610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0ac6fdf9-6dc8-482d-b13c-7db4729dda72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084744 Jun 02 16:35:53.122195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1064/1894] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:53 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:53.745009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e6089578-28c5-4da4-a416-71ee3233660e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:53.745630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e6089578-28c5-4da4-a416-71ee3233660e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:53.752639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6089578-28c5-4da4-a416-71ee3233660e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:53.753101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6089578-28c5-4da4-a416-71ee3233660e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:53.753849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6089578-28c5-4da4-a416-71ee3233660e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:53.754316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6089578-28c5-4da4-a416-71ee3233660e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:53.883117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e6089578-28c5-4da4-a416-71ee3233660e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:53.891787 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e6089578-28c5-4da4-a416-71ee3233660e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150641 Jun 02 16:35:53.892358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 831/1895] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:53 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:54.144195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1418d991-1f8d-42b7-987e-63acb2a44c06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:54.144734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1418d991-1f8d-42b7-987e-63acb2a44c06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:54.151266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1418d991-1f8d-42b7-987e-63acb2a44c06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:54.151811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1418d991-1f8d-42b7-987e-63acb2a44c06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:54.152576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1418d991-1f8d-42b7-987e-63acb2a44c06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:54.153018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1418d991-1f8d-42b7-987e-63acb2a44c06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:54.218902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1418d991-1f8d-42b7-987e-63acb2a44c06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:54.226867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1418d991-1f8d-42b7-987e-63acb2a44c06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086578 Jun 02 16:35:54.227432 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1065/1896] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:54 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:54.909200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-83d56e21-8069-4ebc-ac6f-c606490be000 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:54.909760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-83d56e21-8069-4ebc-ac6f-c606490be000 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:54.916148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83d56e21-8069-4ebc-ac6f-c606490be000 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:54.916614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83d56e21-8069-4ebc-ac6f-c606490be000 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:54.917366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83d56e21-8069-4ebc-ac6f-c606490be000 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:54.917797 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83d56e21-8069-4ebc-ac6f-c606490be000 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:55.049543 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-83d56e21-8069-4ebc-ac6f-c606490be000 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:55.057524 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-83d56e21-8069-4ebc-ac6f-c606490be000 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152379 Jun 02 16:35:55.058103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 832/1897] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:54 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:55.244297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e69bfbc1-fa65-4307-8e82-b9c34d125b7c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:55.244914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e69bfbc1-fa65-4307-8e82-b9c34d125b7c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:55.251495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e69bfbc1-fa65-4307-8e82-b9c34d125b7c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:55.261942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e69bfbc1-fa65-4307-8e82-b9c34d125b7c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:55.261942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e69bfbc1-fa65-4307-8e82-b9c34d125b7c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:55.261942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e69bfbc1-fa65-4307-8e82-b9c34d125b7c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:55.313895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e69bfbc1-fa65-4307-8e82-b9c34d125b7c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:55.316089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:35:55.322516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e69bfbc1-fa65-4307-8e82-b9c34d125b7c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082062 Jun 02 16:35:55.324276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1066/1898] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:56.073849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7b2537d9-8a4c-4d5e-81c6-392268e59d30 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:56.074477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7b2537d9-8a4c-4d5e-81c6-392268e59d30 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:56.081352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b2537d9-8a4c-4d5e-81c6-392268e59d30 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:56.081804 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b2537d9-8a4c-4d5e-81c6-392268e59d30 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:56.082611 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b2537d9-8a4c-4d5e-81c6-392268e59d30 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:56.083053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7b2537d9-8a4c-4d5e-81c6-392268e59d30 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:56.212012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7b2537d9-8a4c-4d5e-81c6-392268e59d30 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:56.221045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7b2537d9-8a4c-4d5e-81c6-392268e59d30 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151052 Jun 02 16:35:56.221831 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 833/1899] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:56 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:56.339480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a215c83a-bbb2-4541-a96e-82ca7436e909 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:56.340095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a215c83a-bbb2-4541-a96e-82ca7436e909 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:56.347955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a215c83a-bbb2-4541-a96e-82ca7436e909 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:56.348402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a215c83a-bbb2-4541-a96e-82ca7436e909 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:56.349160 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a215c83a-bbb2-4541-a96e-82ca7436e909 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:56.349596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a215c83a-bbb2-4541-a96e-82ca7436e909 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:56.411377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a215c83a-bbb2-4541-a96e-82ca7436e909 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:56.419257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a215c83a-bbb2-4541-a96e-82ca7436e909 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083935 Jun 02 16:35:56.419820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1067/1900] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:57.238744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-60268cb0-3580-4cb9-815c-aad5420fadfe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:57.239390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-60268cb0-3580-4cb9-815c-aad5420fadfe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:57.245898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60268cb0-3580-4cb9-815c-aad5420fadfe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:57.246382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60268cb0-3580-4cb9-815c-aad5420fadfe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:57.247146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60268cb0-3580-4cb9-815c-aad5420fadfe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:57.247586 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-60268cb0-3580-4cb9-815c-aad5420fadfe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:57.383887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-60268cb0-3580-4cb9-815c-aad5420fadfe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:57.392230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-60268cb0-3580-4cb9-815c-aad5420fadfe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.157343 Jun 02 16:35:57.392805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 834/1901] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:57 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:57.436136 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c48cb6e7-39bc-4747-92f2-2d2e34c7cd0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:57.436758 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c48cb6e7-39bc-4747-92f2-2d2e34c7cd0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:57.443376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c48cb6e7-39bc-4747-92f2-2d2e34c7cd0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:57.443827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c48cb6e7-39bc-4747-92f2-2d2e34c7cd0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:57.444591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c48cb6e7-39bc-4747-92f2-2d2e34c7cd0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:57.445037 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c48cb6e7-39bc-4747-92f2-2d2e34c7cd0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:57.509488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c48cb6e7-39bc-4747-92f2-2d2e34c7cd0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:57.517691 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c48cb6e7-39bc-4747-92f2-2d2e34c7cd0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085298 Jun 02 16:35:57.518285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1068/1902] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:57 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:58.409325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f556993a-bfa6-4e12-8a10-8e0d49f31dc1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:58.409937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f556993a-bfa6-4e12-8a10-8e0d49f31dc1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:58.416470 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f556993a-bfa6-4e12-8a10-8e0d49f31dc1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:58.416921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f556993a-bfa6-4e12-8a10-8e0d49f31dc1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:58.417684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f556993a-bfa6-4e12-8a10-8e0d49f31dc1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:58.418146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f556993a-bfa6-4e12-8a10-8e0d49f31dc1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:58.534566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8ab78a5e-3796-4cc2-89c7-c6def873b64b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:58.535242 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8ab78a5e-3796-4cc2-89c7-c6def873b64b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:58.541626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ab78a5e-3796-4cc2-89c7-c6def873b64b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:58.542100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ab78a5e-3796-4cc2-89c7-c6def873b64b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:58.542869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ab78a5e-3796-4cc2-89c7-c6def873b64b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:58.543305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ab78a5e-3796-4cc2-89c7-c6def873b64b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:58.549165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f556993a-bfa6-4e12-8a10-8e0d49f31dc1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:58.557083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f556993a-bfa6-4e12-8a10-8e0d49f31dc1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151588 Jun 02 16:35:58.557847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 835/1903] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:58 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:35:58.604397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8ab78a5e-3796-4cc2-89c7-c6def873b64b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:58.612792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8ab78a5e-3796-4cc2-89c7-c6def873b64b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082040 Jun 02 16:35:58.613352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1069/1904] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:58 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:35:59.575430 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9b9ce87f-ea08-4b46-9ee1-658dc0694e71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:59.576030 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9b9ce87f-ea08-4b46-9ee1-658dc0694e71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:59.582686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b9ce87f-ea08-4b46-9ee1-658dc0694e71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:59.583138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b9ce87f-ea08-4b46-9ee1-658dc0694e71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:59.584004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b9ce87f-ea08-4b46-9ee1-658dc0694e71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:59.584437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9b9ce87f-ea08-4b46-9ee1-658dc0694e71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:59.629099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f3aca8e5-6c4b-4909-880b-8037e4e1fc05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:35:59.629708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f3aca8e5-6c4b-4909-880b-8037e4e1fc05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:35:59.636349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3aca8e5-6c4b-4909-880b-8037e4e1fc05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:59.638967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3aca8e5-6c4b-4909-880b-8037e4e1fc05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:59.638967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3aca8e5-6c4b-4909-880b-8037e4e1fc05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:35:59.638967 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f3aca8e5-6c4b-4909-880b-8037e4e1fc05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:35:59.701382 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f3aca8e5-6c4b-4909-880b-8037e4e1fc05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:59.709745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f3aca8e5-6c4b-4909-880b-8037e4e1fc05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084498 Jun 02 16:35:59.710549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1070/1905] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:59 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:35:59.720591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9b9ce87f-ea08-4b46-9ee1-658dc0694e71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:35:59.728879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9b9ce87f-ea08-4b46-9ee1-658dc0694e71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.157305 Jun 02 16:35:59.729450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 836/1906] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:35:59 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:00.726812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-65cf06d5-902c-4d78-809c-911d75482bb6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:00.727422 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-65cf06d5-902c-4d78-809c-911d75482bb6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:00.734428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-65cf06d5-902c-4d78-809c-911d75482bb6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:00.734875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-65cf06d5-902c-4d78-809c-911d75482bb6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:00.735626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-65cf06d5-902c-4d78-809c-911d75482bb6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:00.736054 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-65cf06d5-902c-4d78-809c-911d75482bb6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:00.746917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f5535123-a37a-47a2-8781-1d5388d2fb1d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:00.747537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f5535123-a37a-47a2-8781-1d5388d2fb1d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:00.755395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f5535123-a37a-47a2-8781-1d5388d2fb1d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:00.755845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f5535123-a37a-47a2-8781-1d5388d2fb1d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:00.756621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f5535123-a37a-47a2-8781-1d5388d2fb1d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:00.757061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f5535123-a37a-47a2-8781-1d5388d2fb1d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:00.799511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-65cf06d5-902c-4d78-809c-911d75482bb6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:00.807802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-65cf06d5-902c-4d78-809c-911d75482bb6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084828 Jun 02 16:36:00.808379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1071/1907] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:00.890029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f5535123-a37a-47a2-8781-1d5388d2fb1d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:00.898285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f5535123-a37a-47a2-8781-1d5388d2fb1d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.155224 Jun 02 16:36:00.898855 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 837/1908] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:00 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:01.825100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e19c4f9b-b43f-4179-9820-95269d7d9898 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:01.825719 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e19c4f9b-b43f-4179-9820-95269d7d9898 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:01.833530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e19c4f9b-b43f-4179-9820-95269d7d9898 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:01.833983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e19c4f9b-b43f-4179-9820-95269d7d9898 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:01.834779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e19c4f9b-b43f-4179-9820-95269d7d9898 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:01.835218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e19c4f9b-b43f-4179-9820-95269d7d9898 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:01.901399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e19c4f9b-b43f-4179-9820-95269d7d9898 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:01.909411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e19c4f9b-b43f-4179-9820-95269d7d9898 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.088206 Jun 02 16:36:01.909973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1072/1909] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:01 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:01.915304 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-eeb63d2f-fa53-4506-b4e9-b6021bec560b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:01.915909 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-eeb63d2f-fa53-4506-b4e9-b6021bec560b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:01.922422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eeb63d2f-fa53-4506-b4e9-b6021bec560b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:01.922868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eeb63d2f-fa53-4506-b4e9-b6021bec560b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:01.923623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eeb63d2f-fa53-4506-b4e9-b6021bec560b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:01.924058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eeb63d2f-fa53-4506-b4e9-b6021bec560b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:02.052199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eeb63d2f-fa53-4506-b4e9-b6021bec560b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:02.060065 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-eeb63d2f-fa53-4506-b4e9-b6021bec560b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148477 Jun 02 16:36:02.060635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 838/1910] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:01 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:02.926230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0e6f8d16-8a4f-4b50-afcd-c0a1741b4db7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:02.926834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0e6f8d16-8a4f-4b50-afcd-c0a1741b4db7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:02.933466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e6f8d16-8a4f-4b50-afcd-c0a1741b4db7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:02.933911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e6f8d16-8a4f-4b50-afcd-c0a1741b4db7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:02.934697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e6f8d16-8a4f-4b50-afcd-c0a1741b4db7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:02.935141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e6f8d16-8a4f-4b50-afcd-c0a1741b4db7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:02.996662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0e6f8d16-8a4f-4b50-afcd-c0a1741b4db7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:03.004737 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0e6f8d16-8a4f-4b50-afcd-c0a1741b4db7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082391 Jun 02 16:36:03.005295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1073/1911] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:03.078486 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4d2b77fc-db06-4736-9198-5bf41776962f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:03.079135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4d2b77fc-db06-4736-9198-5bf41776962f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:03.085704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d2b77fc-db06-4736-9198-5bf41776962f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:03.086185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d2b77fc-db06-4736-9198-5bf41776962f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:03.086955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d2b77fc-db06-4736-9198-5bf41776962f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:03.087396 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d2b77fc-db06-4736-9198-5bf41776962f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:03.220502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4d2b77fc-db06-4736-9198-5bf41776962f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:03.222714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:03.229025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4d2b77fc-db06-4736-9198-5bf41776962f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.155190 Jun 02 16:36:03.229592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 839/1912] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:03 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:04.021330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7461ec9d-909a-472c-809d-b5965c42578e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:04.021972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7461ec9d-909a-472c-809d-b5965c42578e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:04.028508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7461ec9d-909a-472c-809d-b5965c42578e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:04.028953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7461ec9d-909a-472c-809d-b5965c42578e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:04.029699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7461ec9d-909a-472c-809d-b5965c42578e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:04.030154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7461ec9d-909a-472c-809d-b5965c42578e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:04.090449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7461ec9d-909a-472c-809d-b5965c42578e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:04.098523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7461ec9d-909a-472c-809d-b5965c42578e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081056 Jun 02 16:36:04.099087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1074/1913] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:04 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:04.246420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b114a51a-9ec4-4ef8-8c99-932841d50c49 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:04.247033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b114a51a-9ec4-4ef8-8c99-932841d50c49 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:04.254422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b114a51a-9ec4-4ef8-8c99-932841d50c49 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:04.254869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b114a51a-9ec4-4ef8-8c99-932841d50c49 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:04.255630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b114a51a-9ec4-4ef8-8c99-932841d50c49 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:04.256064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b114a51a-9ec4-4ef8-8c99-932841d50c49 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:04.385420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b114a51a-9ec4-4ef8-8c99-932841d50c49 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:04.393417 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b114a51a-9ec4-4ef8-8c99-932841d50c49 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150796 Jun 02 16:36:04.393981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 840/1914] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:04 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:05.115712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b43d6473-4193-4894-adab-a6cc78519f4c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:05.116349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b43d6473-4193-4894-adab-a6cc78519f4c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:05.122921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b43d6473-4193-4894-adab-a6cc78519f4c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:05.123368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b43d6473-4193-4894-adab-a6cc78519f4c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:05.124190 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b43d6473-4193-4894-adab-a6cc78519f4c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:05.124653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b43d6473-4193-4894-adab-a6cc78519f4c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:05.196356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b43d6473-4193-4894-adab-a6cc78519f4c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:05.204806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b43d6473-4193-4894-adab-a6cc78519f4c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.093065 Jun 02 16:36:05.205354 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1075/1915] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:05.411053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3cad353b-cae5-4681-a806-801e17a00642 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:05.411591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3cad353b-cae5-4681-a806-801e17a00642 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:05.418001 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3cad353b-cae5-4681-a806-801e17a00642 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:05.418479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3cad353b-cae5-4681-a806-801e17a00642 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:05.419236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3cad353b-cae5-4681-a806-801e17a00642 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:05.419668 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3cad353b-cae5-4681-a806-801e17a00642 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:05.550905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3cad353b-cae5-4681-a806-801e17a00642 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:05.558860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3cad353b-cae5-4681-a806-801e17a00642 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151825 Jun 02 16:36:05.559421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 841/1916] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:05 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:06.223035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f63cf912-d8e6-4428-bee2-289b081f192a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:06.223656 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f63cf912-d8e6-4428-bee2-289b081f192a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:06.230336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f63cf912-d8e6-4428-bee2-289b081f192a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:06.230790 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f63cf912-d8e6-4428-bee2-289b081f192a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:06.231558 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f63cf912-d8e6-4428-bee2-289b081f192a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:06.232005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f63cf912-d8e6-4428-bee2-289b081f192a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:06.295251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f63cf912-d8e6-4428-bee2-289b081f192a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:06.303432 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f63cf912-d8e6-4428-bee2-289b081f192a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084549 Jun 02 16:36:06.304001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1076/1917] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:06.576005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8e08275c-6839-469a-8ba6-5ec33379f255 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:06.576561 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8e08275c-6839-469a-8ba6-5ec33379f255 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:06.583589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e08275c-6839-469a-8ba6-5ec33379f255 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:06.584033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e08275c-6839-469a-8ba6-5ec33379f255 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:06.584795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e08275c-6839-469a-8ba6-5ec33379f255 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:06.585229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e08275c-6839-469a-8ba6-5ec33379f255 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:06.720961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8e08275c-6839-469a-8ba6-5ec33379f255 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:06.729119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8e08275c-6839-469a-8ba6-5ec33379f255 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.157114 Jun 02 16:36:06.729690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 842/1918] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:06 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:07.320821 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e1dceaff-1a92-42eb-a8b3-35abec1c3990 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:07.321367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e1dceaff-1a92-42eb-a8b3-35abec1c3990 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:07.327873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1dceaff-1a92-42eb-a8b3-35abec1c3990 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:07.328323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1dceaff-1a92-42eb-a8b3-35abec1c3990 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:07.329087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1dceaff-1a92-42eb-a8b3-35abec1c3990 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:07.329525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e1dceaff-1a92-42eb-a8b3-35abec1c3990 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:07.390527 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e1dceaff-1a92-42eb-a8b3-35abec1c3990 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:07.398377 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e1dceaff-1a92-42eb-a8b3-35abec1c3990 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081474 Jun 02 16:36:07.398942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1077/1919] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:07.747064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2679e098-1a58-411a-b5aa-e09d48c89668 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:07.747797 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2679e098-1a58-411a-b5aa-e09d48c89668 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:07.755551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2679e098-1a58-411a-b5aa-e09d48c89668 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:07.755997 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2679e098-1a58-411a-b5aa-e09d48c89668 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:07.756759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2679e098-1a58-411a-b5aa-e09d48c89668 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:07.757189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2679e098-1a58-411a-b5aa-e09d48c89668 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:07.888349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2679e098-1a58-411a-b5aa-e09d48c89668 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:07.897237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2679e098-1a58-411a-b5aa-e09d48c89668 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153984 Jun 02 16:36:07.897802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 843/1920] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:07 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:08.416640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-52f1e726-98bf-468d-b4f5-1c33bb079694 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:08.417279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-52f1e726-98bf-468d-b4f5-1c33bb079694 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:08.424357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-52f1e726-98bf-468d-b4f5-1c33bb079694 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:08.424750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-52f1e726-98bf-468d-b4f5-1c33bb079694 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:08.425509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-52f1e726-98bf-468d-b4f5-1c33bb079694 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:08.425948 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-52f1e726-98bf-468d-b4f5-1c33bb079694 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:08.488919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-52f1e726-98bf-468d-b4f5-1c33bb079694 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:08.496787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-52f1e726-98bf-468d-b4f5-1c33bb079694 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084051 Jun 02 16:36:08.497346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1078/1921] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:08 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:08.914666 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e7c652a9-70b0-4259-a39b-3e754ceb5d76 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:08.915314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e7c652a9-70b0-4259-a39b-3e754ceb5d76 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:08.921834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e7c652a9-70b0-4259-a39b-3e754ceb5d76 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:08.922323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e7c652a9-70b0-4259-a39b-3e754ceb5d76 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:08.923094 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e7c652a9-70b0-4259-a39b-3e754ceb5d76 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:08.923529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e7c652a9-70b0-4259-a39b-3e754ceb5d76 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:09.054255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e7c652a9-70b0-4259-a39b-3e754ceb5d76 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:09.062532 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e7c652a9-70b0-4259-a39b-3e754ceb5d76 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151893 Jun 02 16:36:09.063122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 844/1922] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:08 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:09.515178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9171dfca-17e9-42b2-ac07-09de962163a5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:09.515742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9171dfca-17e9-42b2-ac07-09de962163a5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:09.522164 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9171dfca-17e9-42b2-ac07-09de962163a5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:09.522622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9171dfca-17e9-42b2-ac07-09de962163a5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:09.523380 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9171dfca-17e9-42b2-ac07-09de962163a5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:09.523819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9171dfca-17e9-42b2-ac07-09de962163a5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:09.584621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9171dfca-17e9-42b2-ac07-09de962163a5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:09.593272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9171dfca-17e9-42b2-ac07-09de962163a5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082604 Jun 02 16:36:09.593818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1079/1923] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:10.080057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-55675809-0b3a-4c67-a320-19a6058f6150 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:10.080677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-55675809-0b3a-4c67-a320-19a6058f6150 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:10.087272 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55675809-0b3a-4c67-a320-19a6058f6150 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:10.087726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55675809-0b3a-4c67-a320-19a6058f6150 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:10.088747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55675809-0b3a-4c67-a320-19a6058f6150 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:10.089184 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-55675809-0b3a-4c67-a320-19a6058f6150 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:10.219497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-55675809-0b3a-4c67-a320-19a6058f6150 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:10.227303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-55675809-0b3a-4c67-a320-19a6058f6150 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151605 Jun 02 16:36:10.227864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 845/1924] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:10 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:10.609894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2063762e-d80b-4982-ab62-fdab31db5120 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:10.610613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2063762e-d80b-4982-ab62-fdab31db5120 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:10.617096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2063762e-d80b-4982-ab62-fdab31db5120 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:10.617482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2063762e-d80b-4982-ab62-fdab31db5120 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:10.618261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2063762e-d80b-4982-ab62-fdab31db5120 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:10.618694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2063762e-d80b-4982-ab62-fdab31db5120 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:10.682537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2063762e-d80b-4982-ab62-fdab31db5120 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:10.692124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2063762e-d80b-4982-ab62-fdab31db5120 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086293 Jun 02 16:36:10.692685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1080/1925] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:10 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:11.246830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-124f0151-51e1-4886-97b3-57ea6e2b668e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:11.247490 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-124f0151-51e1-4886-97b3-57ea6e2b668e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:11.254993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-124f0151-51e1-4886-97b3-57ea6e2b668e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:11.255444 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-124f0151-51e1-4886-97b3-57ea6e2b668e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:11.256228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-124f0151-51e1-4886-97b3-57ea6e2b668e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:11.256671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-124f0151-51e1-4886-97b3-57ea6e2b668e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:11.406245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-124f0151-51e1-4886-97b3-57ea6e2b668e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:11.415588 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-124f0151-51e1-4886-97b3-57ea6e2b668e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.174355 Jun 02 16:36:11.416166 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 846/1926] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:11 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:11.709537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-67c5d7f3-3a0d-42ef-a53a-786475e1cc51 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:11.710183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-67c5d7f3-3a0d-42ef-a53a-786475e1cc51 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:11.716894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-67c5d7f3-3a0d-42ef-a53a-786475e1cc51 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:11.718011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-67c5d7f3-3a0d-42ef-a53a-786475e1cc51 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:11.719035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-67c5d7f3-3a0d-42ef-a53a-786475e1cc51 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:11.719221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-67c5d7f3-3a0d-42ef-a53a-786475e1cc51 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:11.788140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-67c5d7f3-3a0d-42ef-a53a-786475e1cc51 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:11.797510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-67c5d7f3-3a0d-42ef-a53a-786475e1cc51 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.091465 Jun 02 16:36:11.798598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1081/1927] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:11 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:12.434043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e4bca149-6db9-41c8-8233-f2942a79cafb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:12.434663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e4bca149-6db9-41c8-8233-f2942a79cafb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:12.441595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e4bca149-6db9-41c8-8233-f2942a79cafb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:12.442037 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e4bca149-6db9-41c8-8233-f2942a79cafb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:12.442838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e4bca149-6db9-41c8-8233-f2942a79cafb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:12.443273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e4bca149-6db9-41c8-8233-f2942a79cafb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:12.570324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e4bca149-6db9-41c8-8233-f2942a79cafb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:12.578834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e4bca149-6db9-41c8-8233-f2942a79cafb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148795 Jun 02 16:36:12.579411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 847/1928] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:12 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:12.815700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-96f7e88d-0ccb-48bc-9f85-58a68b40b627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:12.816874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-96f7e88d-0ccb-48bc-9f85-58a68b40b627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:12.823309 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96f7e88d-0ccb-48bc-9f85-58a68b40b627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:12.823754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96f7e88d-0ccb-48bc-9f85-58a68b40b627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:12.824504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96f7e88d-0ccb-48bc-9f85-58a68b40b627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:12.824934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-96f7e88d-0ccb-48bc-9f85-58a68b40b627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:12.885246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-96f7e88d-0ccb-48bc-9f85-58a68b40b627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:12.893218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-96f7e88d-0ccb-48bc-9f85-58a68b40b627 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081438 Jun 02 16:36:12.893769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1082/1929] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:13.597197 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d46e19f0-f2f0-4b08-a8ea-444915f7ab17 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:13.597766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d46e19f0-f2f0-4b08-a8ea-444915f7ab17 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:13.604174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d46e19f0-f2f0-4b08-a8ea-444915f7ab17 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:13.604616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d46e19f0-f2f0-4b08-a8ea-444915f7ab17 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:13.605371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d46e19f0-f2f0-4b08-a8ea-444915f7ab17 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:13.605802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d46e19f0-f2f0-4b08-a8ea-444915f7ab17 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:13.735200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d46e19f0-f2f0-4b08-a8ea-444915f7ab17 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:13.743094 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d46e19f0-f2f0-4b08-a8ea-444915f7ab17 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150654 Jun 02 16:36:13.743659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 848/1930] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:13 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:13.910654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2d44da03-982b-4845-8cfc-87f5b3f8b72d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:13.911735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2d44da03-982b-4845-8cfc-87f5b3f8b72d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:13.922776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d44da03-982b-4845-8cfc-87f5b3f8b72d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:13.923577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d44da03-982b-4845-8cfc-87f5b3f8b72d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:13.924715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d44da03-982b-4845-8cfc-87f5b3f8b72d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:13.925205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2d44da03-982b-4845-8cfc-87f5b3f8b72d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:13.942059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:13.990562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2d44da03-982b-4845-8cfc-87f5b3f8b72d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:13.999459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2d44da03-982b-4845-8cfc-87f5b3f8b72d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.092718 Jun 02 16:36:14.000066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1083/1931] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:13 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:14.760677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6e223b49-27d5-4fe3-bd7b-407e90d937c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:14.761311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6e223b49-27d5-4fe3-bd7b-407e90d937c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:14.763611 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=52 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:14.768329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6e223b49-27d5-4fe3-bd7b-407e90d937c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:14.768774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6e223b49-27d5-4fe3-bd7b-407e90d937c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:14.769534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6e223b49-27d5-4fe3-bd7b-407e90d937c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:14.769974 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6e223b49-27d5-4fe3-bd7b-407e90d937c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:14.902854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6e223b49-27d5-4fe3-bd7b-407e90d937c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:14.911466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6e223b49-27d5-4fe3-bd7b-407e90d937c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154648 Jun 02 16:36:14.912029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 849/1932] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:14 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:15.017894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-23fa6d34-4f54-4634-b231-07a5d184041c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:15.018462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-23fa6d34-4f54-4634-b231-07a5d184041c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:15.024674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23fa6d34-4f54-4634-b231-07a5d184041c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:15.025128 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23fa6d34-4f54-4634-b231-07a5d184041c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:15.025890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23fa6d34-4f54-4634-b231-07a5d184041c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:15.026355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23fa6d34-4f54-4634-b231-07a5d184041c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:15.091878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-23fa6d34-4f54-4634-b231-07a5d184041c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:15.099991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-23fa6d34-4f54-4634-b231-07a5d184041c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086967 Jun 02 16:36:15.100550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1084/1933] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:15 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:15.928311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-13191950-263a-4c56-8b04-d487b12c937e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:15.928912 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-13191950-263a-4c56-8b04-d487b12c937e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:15.935366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13191950-263a-4c56-8b04-d487b12c937e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:15.935842 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13191950-263a-4c56-8b04-d487b12c937e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:15.936712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13191950-263a-4c56-8b04-d487b12c937e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:15.937146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13191950-263a-4c56-8b04-d487b12c937e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:16.066213 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-13191950-263a-4c56-8b04-d487b12c937e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:16.074593 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-13191950-263a-4c56-8b04-d487b12c937e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150070 Jun 02 16:36:16.075160 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 850/1934] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:15 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:16.116335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e68e290e-d353-4823-9c22-a4ddde732528 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:16.116975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e68e290e-d353-4823-9c22-a4ddde732528 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:16.119345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=56 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:16.124499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e68e290e-d353-4823-9c22-a4ddde732528 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:16.124942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e68e290e-d353-4823-9c22-a4ddde732528 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:16.125706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e68e290e-d353-4823-9c22-a4ddde732528 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:16.126168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e68e290e-d353-4823-9c22-a4ddde732528 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:16.190340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e68e290e-d353-4823-9c22-a4ddde732528 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:16.198394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e68e290e-d353-4823-9c22-a4ddde732528 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085886 Jun 02 16:36:16.198953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1085/1935] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:17.092946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d2151ee3-85aa-4e53-a121-75852419a3ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:17.093555 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d2151ee3-85aa-4e53-a121-75852419a3ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:17.100011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2151ee3-85aa-4e53-a121-75852419a3ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:17.100465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2151ee3-85aa-4e53-a121-75852419a3ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:17.101227 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2151ee3-85aa-4e53-a121-75852419a3ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:17.101667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2151ee3-85aa-4e53-a121-75852419a3ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:17.216044 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4e06d838-9bfd-42ec-93ac-731466d98066 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:17.216657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4e06d838-9bfd-42ec-93ac-731466d98066 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:17.223094 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e06d838-9bfd-42ec-93ac-731466d98066 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:17.223537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e06d838-9bfd-42ec-93ac-731466d98066 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:17.224351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e06d838-9bfd-42ec-93ac-731466d98066 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:17.224791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e06d838-9bfd-42ec-93ac-731466d98066 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:17.235204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d2151ee3-85aa-4e53-a121-75852419a3ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:17.243401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d2151ee3-85aa-4e53-a121-75852419a3ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154338 Jun 02 16:36:17.244182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 851/1936] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:17 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:17.285168 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4e06d838-9bfd-42ec-93ac-731466d98066 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:17.292935 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4e06d838-9bfd-42ec-93ac-731466d98066 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081049 Jun 02 16:36:17.293486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1086/1937] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:18.261738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-59eddbfc-5da2-4443-ac1e-fa8f939cd520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:18.262296 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-59eddbfc-5da2-4443-ac1e-fa8f939cd520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:18.269073 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59eddbfc-5da2-4443-ac1e-fa8f939cd520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:18.269522 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59eddbfc-5da2-4443-ac1e-fa8f939cd520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:18.270321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59eddbfc-5da2-4443-ac1e-fa8f939cd520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:18.270761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-59eddbfc-5da2-4443-ac1e-fa8f939cd520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:18.310213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-01ed0906-332b-45fc-8ea8-d9484875067e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:18.310830 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-01ed0906-332b-45fc-8ea8-d9484875067e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:18.317245 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01ed0906-332b-45fc-8ea8-d9484875067e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:18.317689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01ed0906-332b-45fc-8ea8-d9484875067e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:18.318483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01ed0906-332b-45fc-8ea8-d9484875067e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:18.318919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-01ed0906-332b-45fc-8ea8-d9484875067e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:18.381060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-01ed0906-332b-45fc-8ea8-d9484875067e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:18.389335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-01ed0906-332b-45fc-8ea8-d9484875067e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082523 Jun 02 16:36:18.390280 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1087/1938] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:18.400084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-59eddbfc-5da2-4443-ac1e-fa8f939cd520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:18.408751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-59eddbfc-5da2-4443-ac1e-fa8f939cd520 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150899 Jun 02 16:36:18.409305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 852/1939] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:18 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:19.406714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d93795b8-e79c-4995-a4aa-fb629837518b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:19.407287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d93795b8-e79c-4995-a4aa-fb629837518b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:19.413681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d93795b8-e79c-4995-a4aa-fb629837518b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:19.414161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d93795b8-e79c-4995-a4aa-fb629837518b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:19.414928 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d93795b8-e79c-4995-a4aa-fb629837518b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:19.415368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d93795b8-e79c-4995-a4aa-fb629837518b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:19.425715 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cb353877-594b-4030-acdc-6ea23dddd40e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:19.426365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cb353877-594b-4030-acdc-6ea23dddd40e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:19.432805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb353877-594b-4030-acdc-6ea23dddd40e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:19.433252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb353877-594b-4030-acdc-6ea23dddd40e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:19.434016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb353877-594b-4030-acdc-6ea23dddd40e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:19.434479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb353877-594b-4030-acdc-6ea23dddd40e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:19.479918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d93795b8-e79c-4995-a4aa-fb629837518b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:19.488294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d93795b8-e79c-4995-a4aa-fb629837518b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086088 Jun 02 16:36:19.488897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1088/1940] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:19 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:19.566347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cb353877-594b-4030-acdc-6ea23dddd40e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:19.574315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cb353877-594b-4030-acdc-6ea23dddd40e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152540 Jun 02 16:36:19.574879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 853/1941] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:19 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:20.505321 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e65c4050-7e4d-4be8-a7a2-228c3d208cea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:20.505884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e65c4050-7e4d-4be8-a7a2-228c3d208cea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:20.512405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e65c4050-7e4d-4be8-a7a2-228c3d208cea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:20.512890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e65c4050-7e4d-4be8-a7a2-228c3d208cea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:20.513653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e65c4050-7e4d-4be8-a7a2-228c3d208cea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:20.515003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e65c4050-7e4d-4be8-a7a2-228c3d208cea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:20.575152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e65c4050-7e4d-4be8-a7a2-228c3d208cea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:20.583647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e65c4050-7e4d-4be8-a7a2-228c3d208cea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082258 Jun 02 16:36:20.584214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1089/1942] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:20.591413 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7f12b077-3c6b-43d5-9a96-5fd5167ce752 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:20.592295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7f12b077-3c6b-43d5-9a96-5fd5167ce752 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:20.598796 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f12b077-3c6b-43d5-9a96-5fd5167ce752 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:20.599241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f12b077-3c6b-43d5-9a96-5fd5167ce752 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:20.600023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f12b077-3c6b-43d5-9a96-5fd5167ce752 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:20.600455 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f12b077-3c6b-43d5-9a96-5fd5167ce752 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:20.733114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7f12b077-3c6b-43d5-9a96-5fd5167ce752 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:20.740910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7f12b077-3c6b-43d5-9a96-5fd5167ce752 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153549 Jun 02 16:36:20.741472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 854/1943] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:20 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:21.601018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-08d1625a-021f-4f95-8bf0-8766ec4d4513 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:21.601626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-08d1625a-021f-4f95-8bf0-8766ec4d4513 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:21.609042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08d1625a-021f-4f95-8bf0-8766ec4d4513 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:21.609548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08d1625a-021f-4f95-8bf0-8766ec4d4513 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:21.610333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08d1625a-021f-4f95-8bf0-8766ec4d4513 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:21.610805 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-08d1625a-021f-4f95-8bf0-8766ec4d4513 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:21.673386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-08d1625a-021f-4f95-8bf0-8766ec4d4513 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:21.681296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-08d1625a-021f-4f95-8bf0-8766ec4d4513 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084274 Jun 02 16:36:21.681861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1090/1944] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:21.759325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4af1fe48-b204-457e-bee3-ec10fbdfa4d0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:21.759973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4af1fe48-b204-457e-bee3-ec10fbdfa4d0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:21.767079 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4af1fe48-b204-457e-bee3-ec10fbdfa4d0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:21.767585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4af1fe48-b204-457e-bee3-ec10fbdfa4d0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:21.768466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4af1fe48-b204-457e-bee3-ec10fbdfa4d0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:21.768856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4af1fe48-b204-457e-bee3-ec10fbdfa4d0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:21.899573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4af1fe48-b204-457e-bee3-ec10fbdfa4d0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:21.907671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4af1fe48-b204-457e-bee3-ec10fbdfa4d0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152655 Jun 02 16:36:21.908241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 855/1945] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:21 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:22.699070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-897ecaa7-05a9-4114-ba04-e3ebdc82cfe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:22.703952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-897ecaa7-05a9-4114-ba04-e3ebdc82cfe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:22.706644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-897ecaa7-05a9-4114-ba04-e3ebdc82cfe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:22.707100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-897ecaa7-05a9-4114-ba04-e3ebdc82cfe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:22.707865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-897ecaa7-05a9-4114-ba04-e3ebdc82cfe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:22.708305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-897ecaa7-05a9-4114-ba04-e3ebdc82cfe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:22.769817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-897ecaa7-05a9-4114-ba04-e3ebdc82cfe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:22.777838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-897ecaa7-05a9-4114-ba04-e3ebdc82cfe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082633 Jun 02 16:36:22.778439 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1091/1946] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:22.925060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d504251e-c748-488f-887e-121a0af3f3cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:22.925676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d504251e-c748-488f-887e-121a0af3f3cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:22.932325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d504251e-c748-488f-887e-121a0af3f3cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:22.932778 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d504251e-c748-488f-887e-121a0af3f3cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:22.933548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d504251e-c748-488f-887e-121a0af3f3cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:22.933988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d504251e-c748-488f-887e-121a0af3f3cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:22.949710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:23.068069 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d504251e-c748-488f-887e-121a0af3f3cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:23.076687 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d504251e-c748-488f-887e-121a0af3f3cb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154876 Jun 02 16:36:23.077384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 856/1947] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:22 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:23.795541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-254e7f7d-f932-43c7-b020-0473f975759e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:23.796139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-254e7f7d-f932-43c7-b020-0473f975759e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:23.802531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-254e7f7d-f932-43c7-b020-0473f975759e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:23.802975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-254e7f7d-f932-43c7-b020-0473f975759e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:23.803720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-254e7f7d-f932-43c7-b020-0473f975759e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:23.804147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-254e7f7d-f932-43c7-b020-0473f975759e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:23.869782 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-254e7f7d-f932-43c7-b020-0473f975759e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:23.878329 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-254e7f7d-f932-43c7-b020-0473f975759e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086778 Jun 02 16:36:23.878888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1092/1948] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:24.094682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7fc14880-5217-411f-b0df-0e02adedc359 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:24.095203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7fc14880-5217-411f-b0df-0e02adedc359 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:24.101686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7fc14880-5217-411f-b0df-0e02adedc359 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:24.102161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7fc14880-5217-411f-b0df-0e02adedc359 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:24.102917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7fc14880-5217-411f-b0df-0e02adedc359 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:24.103352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7fc14880-5217-411f-b0df-0e02adedc359 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:24.233263 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7fc14880-5217-411f-b0df-0e02adedc359 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:24.241245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7fc14880-5217-411f-b0df-0e02adedc359 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151152 Jun 02 16:36:24.241807 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 857/1949] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:24 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:24.895578 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-19965517-b230-4108-a284-d3190ed78387 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:24.896163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-19965517-b230-4108-a284-d3190ed78387 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:24.902809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19965517-b230-4108-a284-d3190ed78387 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:24.903256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19965517-b230-4108-a284-d3190ed78387 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:24.904152 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19965517-b230-4108-a284-d3190ed78387 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:24.905180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-19965517-b230-4108-a284-d3190ed78387 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:24.965934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-19965517-b230-4108-a284-d3190ed78387 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:24.974458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-19965517-b230-4108-a284-d3190ed78387 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082750 Jun 02 16:36:24.975022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1093/1950] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:25.259124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-575152f1-55c0-4c6d-ba3c-6f441eebafc9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:25.259745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-575152f1-55c0-4c6d-ba3c-6f441eebafc9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:25.266984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-575152f1-55c0-4c6d-ba3c-6f441eebafc9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:25.267436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-575152f1-55c0-4c6d-ba3c-6f441eebafc9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:25.268202 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-575152f1-55c0-4c6d-ba3c-6f441eebafc9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:25.268652 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-575152f1-55c0-4c6d-ba3c-6f441eebafc9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:25.399490 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-575152f1-55c0-4c6d-ba3c-6f441eebafc9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:25.407515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-575152f1-55c0-4c6d-ba3c-6f441eebafc9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152239 Jun 02 16:36:25.408066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 858/1951] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:25 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:25.991091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f5ead2c1-938a-4b1d-a5cf-4e7c9c2227c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:25.991743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f5ead2c1-938a-4b1d-a5cf-4e7c9c2227c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:25.998421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5ead2c1-938a-4b1d-a5cf-4e7c9c2227c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:25.998875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5ead2c1-938a-4b1d-a5cf-4e7c9c2227c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:25.999633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5ead2c1-938a-4b1d-a5cf-4e7c9c2227c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:26.000072 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5ead2c1-938a-4b1d-a5cf-4e7c9c2227c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:26.060722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f5ead2c1-938a-4b1d-a5cf-4e7c9c2227c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:26.068741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f5ead2c1-938a-4b1d-a5cf-4e7c9c2227c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081526 Jun 02 16:36:26.073278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1094/1952] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:25 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:26.424069 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ec8bb025-ec81-4e75-a18e-1641459173c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:26.424689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ec8bb025-ec81-4e75-a18e-1641459173c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:26.431240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ec8bb025-ec81-4e75-a18e-1641459173c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:26.431689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ec8bb025-ec81-4e75-a18e-1641459173c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:26.432449 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ec8bb025-ec81-4e75-a18e-1641459173c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:26.432887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ec8bb025-ec81-4e75-a18e-1641459173c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:26.561962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ec8bb025-ec81-4e75-a18e-1641459173c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:26.569809 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ec8bb025-ec81-4e75-a18e-1641459173c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149654 Jun 02 16:36:26.570401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 859/1953] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:26 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:27.085946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-aed3815d-0e84-4abc-84b1-ab30dfea6049 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:27.086581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-aed3815d-0e84-4abc-84b1-ab30dfea6049 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:27.093644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aed3815d-0e84-4abc-84b1-ab30dfea6049 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:27.094103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aed3815d-0e84-4abc-84b1-ab30dfea6049 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:27.094870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aed3815d-0e84-4abc-84b1-ab30dfea6049 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:27.095305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-aed3815d-0e84-4abc-84b1-ab30dfea6049 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:27.156773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-aed3815d-0e84-4abc-84b1-ab30dfea6049 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:27.164814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-aed3815d-0e84-4abc-84b1-ab30dfea6049 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082739 Jun 02 16:36:27.165386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1095/1954] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:27.587291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a5f5c23c-3fc9-42a9-98e0-f1f3f7938a73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:27.588180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a5f5c23c-3fc9-42a9-98e0-f1f3f7938a73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:27.595261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5f5c23c-3fc9-42a9-98e0-f1f3f7938a73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:27.595705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5f5c23c-3fc9-42a9-98e0-f1f3f7938a73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:27.596460 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5f5c23c-3fc9-42a9-98e0-f1f3f7938a73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:27.596892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5f5c23c-3fc9-42a9-98e0-f1f3f7938a73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:27.727024 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a5f5c23c-3fc9-42a9-98e0-f1f3f7938a73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:27.735052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a5f5c23c-3fc9-42a9-98e0-f1f3f7938a73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151628 Jun 02 16:36:27.735620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 860/1955] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:27 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:28.181540 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1b2b8baa-6146-4f4b-b9c3-3c5c63e3f236 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:28.182200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1b2b8baa-6146-4f4b-b9c3-3c5c63e3f236 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:28.189921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1b2b8baa-6146-4f4b-b9c3-3c5c63e3f236 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:28.190416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1b2b8baa-6146-4f4b-b9c3-3c5c63e3f236 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:28.191189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1b2b8baa-6146-4f4b-b9c3-3c5c63e3f236 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:28.191629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1b2b8baa-6146-4f4b-b9c3-3c5c63e3f236 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:28.256411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1b2b8baa-6146-4f4b-b9c3-3c5c63e3f236 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:28.265332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1b2b8baa-6146-4f4b-b9c3-3c5c63e3f236 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087628 Jun 02 16:36:28.265927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1096/1956] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:28.751754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1fd6aa73-c9ec-47ef-ad3c-149ece981619 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:28.752375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1fd6aa73-c9ec-47ef-ad3c-149ece981619 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:28.758962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1fd6aa73-c9ec-47ef-ad3c-149ece981619 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:28.759418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1fd6aa73-c9ec-47ef-ad3c-149ece981619 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:28.760186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1fd6aa73-c9ec-47ef-ad3c-149ece981619 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:28.760627 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1fd6aa73-c9ec-47ef-ad3c-149ece981619 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:28.894382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1fd6aa73-c9ec-47ef-ad3c-149ece981619 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:28.902418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1fd6aa73-c9ec-47ef-ad3c-149ece981619 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154642 Jun 02 16:36:28.902996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 861/1957] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:28 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:29.283025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eb88255b-d532-4343-ae49-dabcea105c71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:29.284240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eb88255b-d532-4343-ae49-dabcea105c71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:29.290767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb88255b-d532-4343-ae49-dabcea105c71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:29.291209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb88255b-d532-4343-ae49-dabcea105c71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:29.291959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb88255b-d532-4343-ae49-dabcea105c71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:29.292389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb88255b-d532-4343-ae49-dabcea105c71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:29.352603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-eb88255b-d532-4343-ae49-dabcea105c71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:29.360461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eb88255b-d532-4343-ae49-dabcea105c71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081376 Jun 02 16:36:29.361014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1097/1958] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:29.919905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7c1e8446-02b6-4129-87c6-77d5b18a96a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:29.921185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7c1e8446-02b6-4129-87c6-77d5b18a96a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:29.927389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7c1e8446-02b6-4129-87c6-77d5b18a96a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:29.927836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7c1e8446-02b6-4129-87c6-77d5b18a96a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:29.928584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7c1e8446-02b6-4129-87c6-77d5b18a96a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:29.929010 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7c1e8446-02b6-4129-87c6-77d5b18a96a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:30.057339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7c1e8446-02b6-4129-87c6-77d5b18a96a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:30.066053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7c1e8446-02b6-4129-87c6-77d5b18a96a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149984 Jun 02 16:36:30.066659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 862/1959] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:29 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:30.377773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-31dd7bf5-318c-4249-8239-6af52b7b4b6b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:30.378429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-31dd7bf5-318c-4249-8239-6af52b7b4b6b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:30.384942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31dd7bf5-318c-4249-8239-6af52b7b4b6b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:30.385395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31dd7bf5-318c-4249-8239-6af52b7b4b6b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:30.386175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31dd7bf5-318c-4249-8239-6af52b7b4b6b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:30.386624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31dd7bf5-318c-4249-8239-6af52b7b4b6b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:30.451158 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-31dd7bf5-318c-4249-8239-6af52b7b4b6b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:30.459837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-31dd7bf5-318c-4249-8239-6af52b7b4b6b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086420 Jun 02 16:36:30.460400 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1098/1960] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:30.900310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:36:30.900534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:36:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:36:31.083020 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-53df3682-95ad-455e-b246-f74e322295c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:31.083643 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-53df3682-95ad-455e-b246-f74e322295c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:31.090610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-53df3682-95ad-455e-b246-f74e322295c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:31.091064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-53df3682-95ad-455e-b246-f74e322295c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:31.092429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-53df3682-95ad-455e-b246-f74e322295c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:31.092924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-53df3682-95ad-455e-b246-f74e322295c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:31.224128 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-53df3682-95ad-455e-b246-f74e322295c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:31.232086 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-53df3682-95ad-455e-b246-f74e322295c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152900 Jun 02 16:36:31.233319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 863/1961] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:31 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:31.476648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-34222154-7045-4e22-aef7-36e333b64091 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:31.477271 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-34222154-7045-4e22-aef7-36e333b64091 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:31.484359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34222154-7045-4e22-aef7-36e333b64091 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:31.484810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34222154-7045-4e22-aef7-36e333b64091 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:31.485571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34222154-7045-4e22-aef7-36e333b64091 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:31.486009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-34222154-7045-4e22-aef7-36e333b64091 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:31.549685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-34222154-7045-4e22-aef7-36e333b64091 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:31.557750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-34222154-7045-4e22-aef7-36e333b64091 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084931 Jun 02 16:36:31.559219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1099/1962] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:31 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:32.249143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-30ee29a7-466b-4ae7-ac64-1595b4690585 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:32.249753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-30ee29a7-466b-4ae7-ac64-1595b4690585 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:32.256238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30ee29a7-466b-4ae7-ac64-1595b4690585 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:32.256682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30ee29a7-466b-4ae7-ac64-1595b4690585 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:32.257449 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30ee29a7-466b-4ae7-ac64-1595b4690585 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:32.257882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-30ee29a7-466b-4ae7-ac64-1595b4690585 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:32.386094 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-30ee29a7-466b-4ae7-ac64-1595b4690585 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:32.393801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:36:32.393997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:36:32.394575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-30ee29a7-466b-4ae7-ac64-1595b4690585 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149294 Jun 02 16:36:32.396049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 864/1963] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:32 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:32.574862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2ebcf33a-d482-48e8-83f4-00678c30902a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:32.575505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2ebcf33a-d482-48e8-83f4-00678c30902a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:32.582770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ebcf33a-d482-48e8-83f4-00678c30902a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:32.583223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ebcf33a-d482-48e8-83f4-00678c30902a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:32.583988 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ebcf33a-d482-48e8-83f4-00678c30902a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:32.584436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ebcf33a-d482-48e8-83f4-00678c30902a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:32.588571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:32.647723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2ebcf33a-d482-48e8-83f4-00678c30902a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:32.655809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2ebcf33a-d482-48e8-83f4-00678c30902a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084824 Jun 02 16:36:32.656366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1100/1964] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:33.413255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6bf076e3-fc96-423a-a17b-6ae3385f36f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:33.413814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6bf076e3-fc96-423a-a17b-6ae3385f36f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:33.421302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bf076e3-fc96-423a-a17b-6ae3385f36f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:33.421761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bf076e3-fc96-423a-a17b-6ae3385f36f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:33.422561 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bf076e3-fc96-423a-a17b-6ae3385f36f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:33.423002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6bf076e3-fc96-423a-a17b-6ae3385f36f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:33.549145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6bf076e3-fc96-423a-a17b-6ae3385f36f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:33.557077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6bf076e3-fc96-423a-a17b-6ae3385f36f9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.147771 Jun 02 16:36:33.557640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 865/1965] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:33 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:33.672964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a57a68c3-ceae-4b7d-87a5-b37f3b70294b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:33.673575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a57a68c3-ceae-4b7d-87a5-b37f3b70294b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:33.680036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a57a68c3-ceae-4b7d-87a5-b37f3b70294b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:33.680549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a57a68c3-ceae-4b7d-87a5-b37f3b70294b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:33.681312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a57a68c3-ceae-4b7d-87a5-b37f3b70294b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:33.681748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a57a68c3-ceae-4b7d-87a5-b37f3b70294b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:33.741581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a57a68c3-ceae-4b7d-87a5-b37f3b70294b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:33.749929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a57a68c3-ceae-4b7d-87a5-b37f3b70294b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081039 Jun 02 16:36:33.750516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1101/1966] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:34.574237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c0ddc65c-c06a-441a-925b-6ebedc358155 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:34.574838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c0ddc65c-c06a-441a-925b-6ebedc358155 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:34.581493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0ddc65c-c06a-441a-925b-6ebedc358155 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:34.581945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0ddc65c-c06a-441a-925b-6ebedc358155 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:34.582741 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0ddc65c-c06a-441a-925b-6ebedc358155 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:34.583179 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0ddc65c-c06a-441a-925b-6ebedc358155 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:34.713476 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c0ddc65c-c06a-441a-925b-6ebedc358155 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:34.721865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c0ddc65c-c06a-441a-925b-6ebedc358155 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151505 Jun 02 16:36:34.722472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 866/1967] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:34 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:34.767471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cde3560b-a7d9-463b-92d4-9e2277ad39c5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:34.768083 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cde3560b-a7d9-463b-92d4-9e2277ad39c5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:34.774525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cde3560b-a7d9-463b-92d4-9e2277ad39c5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:34.774970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cde3560b-a7d9-463b-92d4-9e2277ad39c5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:34.775717 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cde3560b-a7d9-463b-92d4-9e2277ad39c5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:34.776146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cde3560b-a7d9-463b-92d4-9e2277ad39c5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:34.838817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cde3560b-a7d9-463b-92d4-9e2277ad39c5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:34.847599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cde3560b-a7d9-463b-92d4-9e2277ad39c5 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084621 Jun 02 16:36:34.848159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1102/1968] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:35.739254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3493d13c-bea0-4779-89f5-7e992bf90412 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:35.739870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3493d13c-bea0-4779-89f5-7e992bf90412 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:35.748979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3493d13c-bea0-4779-89f5-7e992bf90412 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:35.749438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3493d13c-bea0-4779-89f5-7e992bf90412 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:35.750278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3493d13c-bea0-4779-89f5-7e992bf90412 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:35.750721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3493d13c-bea0-4779-89f5-7e992bf90412 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:35.864467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ea588462-9ee2-4d0a-9927-1cb5ab9cc76f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:35.865062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ea588462-9ee2-4d0a-9927-1cb5ab9cc76f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:35.871459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea588462-9ee2-4d0a-9927-1cb5ab9cc76f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:35.871900 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea588462-9ee2-4d0a-9927-1cb5ab9cc76f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:35.872653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea588462-9ee2-4d0a-9927-1cb5ab9cc76f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:35.873844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea588462-9ee2-4d0a-9927-1cb5ab9cc76f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:35.885998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3493d13c-bea0-4779-89f5-7e992bf90412 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:35.894364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3493d13c-bea0-4779-89f5-7e992bf90412 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.158952 Jun 02 16:36:35.894943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 867/1969] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:35 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:35.934684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ea588462-9ee2-4d0a-9927-1cb5ab9cc76f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:35.943185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ea588462-9ee2-4d0a-9927-1cb5ab9cc76f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082584 Jun 02 16:36:35.943744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1103/1970] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:35 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:36.912145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-de8e36a0-4cc9-4e42-be50-e446bd7febb3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:36.912740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-de8e36a0-4cc9-4e42-be50-e446bd7febb3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:36.919164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de8e36a0-4cc9-4e42-be50-e446bd7febb3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:36.919610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de8e36a0-4cc9-4e42-be50-e446bd7febb3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:36.920365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de8e36a0-4cc9-4e42-be50-e446bd7febb3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:36.920805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de8e36a0-4cc9-4e42-be50-e446bd7febb3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:36.959850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f30e2ee3-d379-4f60-9f45-c6ae4616dc78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:36.960462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f30e2ee3-d379-4f60-9f45-c6ae4616dc78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:36.968012 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f30e2ee3-d379-4f60-9f45-c6ae4616dc78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:36.968453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f30e2ee3-d379-4f60-9f45-c6ae4616dc78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:36.969222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f30e2ee3-d379-4f60-9f45-c6ae4616dc78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:36.969658 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f30e2ee3-d379-4f60-9f45-c6ae4616dc78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:37.037182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f30e2ee3-d379-4f60-9f45-c6ae4616dc78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:37.045097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f30e2ee3-d379-4f60-9f45-c6ae4616dc78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.089006 Jun 02 16:36:37.046256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1104/1971] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:36 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:37.058659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-de8e36a0-4cc9-4e42-be50-e446bd7febb3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:37.067135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-de8e36a0-4cc9-4e42-be50-e446bd7febb3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.158849 Jun 02 16:36:37.067707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 868/1972] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:36 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:38.063139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f7b8242c-5e84-437e-9834-c56bd6c91ed7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:38.063692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f7b8242c-5e84-437e-9834-c56bd6c91ed7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:38.070157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7b8242c-5e84-437e-9834-c56bd6c91ed7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:38.070608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7b8242c-5e84-437e-9834-c56bd6c91ed7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:38.071364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7b8242c-5e84-437e-9834-c56bd6c91ed7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:38.071796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7b8242c-5e84-437e-9834-c56bd6c91ed7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:38.085094 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b942cb11-0346-42b9-a82e-44e5e8b8fda9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:38.085714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b942cb11-0346-42b9-a82e-44e5e8b8fda9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:38.092374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b942cb11-0346-42b9-a82e-44e5e8b8fda9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:38.092823 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b942cb11-0346-42b9-a82e-44e5e8b8fda9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:38.093597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b942cb11-0346-42b9-a82e-44e5e8b8fda9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:38.094033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b942cb11-0346-42b9-a82e-44e5e8b8fda9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:38.133403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f7b8242c-5e84-437e-9834-c56bd6c91ed7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:38.144292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f7b8242c-5e84-437e-9834-c56bd6c91ed7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085692 Jun 02 16:36:38.144880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1105/1973] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:38 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:38.228053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b942cb11-0346-42b9-a82e-44e5e8b8fda9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:38.236800 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b942cb11-0346-42b9-a82e-44e5e8b8fda9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.155583 Jun 02 16:36:38.237359 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 869/1974] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:38 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:39.160871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-217522f8-2bdc-494b-b37b-37be1cd03303 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:39.161492 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-217522f8-2bdc-494b-b37b-37be1cd03303 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:39.168104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-217522f8-2bdc-494b-b37b-37be1cd03303 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:39.168567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-217522f8-2bdc-494b-b37b-37be1cd03303 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:39.169334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-217522f8-2bdc-494b-b37b-37be1cd03303 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:39.170362 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-217522f8-2bdc-494b-b37b-37be1cd03303 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:39.233430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-217522f8-2bdc-494b-b37b-37be1cd03303 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:39.241177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-217522f8-2bdc-494b-b37b-37be1cd03303 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084223 Jun 02 16:36:39.241741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1106/1975] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:39.253794 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1bc5111f-5baa-478b-be09-4e8dc04eaa6a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:39.254459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1bc5111f-5baa-478b-be09-4e8dc04eaa6a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:39.260947 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1bc5111f-5baa-478b-be09-4e8dc04eaa6a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:39.261385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1bc5111f-5baa-478b-be09-4e8dc04eaa6a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:39.262165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1bc5111f-5baa-478b-be09-4e8dc04eaa6a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:39.262596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1bc5111f-5baa-478b-be09-4e8dc04eaa6a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:39.393694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1bc5111f-5baa-478b-be09-4e8dc04eaa6a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:39.401773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1bc5111f-5baa-478b-be09-4e8dc04eaa6a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151708 Jun 02 16:36:39.402349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 870/1976] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:39 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:40.103449 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:36:40.103683 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:36:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:36:40.257968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6eedc158-b0a3-48ca-b552-fd58ba1a30f2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:40.258614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6eedc158-b0a3-48ca-b552-fd58ba1a30f2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:40.266204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6eedc158-b0a3-48ca-b552-fd58ba1a30f2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:40.266720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6eedc158-b0a3-48ca-b552-fd58ba1a30f2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:40.267437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6eedc158-b0a3-48ca-b552-fd58ba1a30f2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:40.267878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6eedc158-b0a3-48ca-b552-fd58ba1a30f2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:40.329747 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6eedc158-b0a3-48ca-b552-fd58ba1a30f2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:40.337610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6eedc158-b0a3-48ca-b552-fd58ba1a30f2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083556 Jun 02 16:36:40.338443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1107/1977] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:40.418793 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4059fb7f-d93d-4ef4-a590-675c7b9ee84c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:40.419394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4059fb7f-d93d-4ef4-a590-675c7b9ee84c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:40.426533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4059fb7f-d93d-4ef4-a590-675c7b9ee84c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:40.426973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4059fb7f-d93d-4ef4-a590-675c7b9ee84c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:40.427728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4059fb7f-d93d-4ef4-a590-675c7b9ee84c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:40.428155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4059fb7f-d93d-4ef4-a590-675c7b9ee84c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:40.563008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4059fb7f-d93d-4ef4-a590-675c7b9ee84c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:40.570896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4059fb7f-d93d-4ef4-a590-675c7b9ee84c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.155969 Jun 02 16:36:40.571456 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 871/1978] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:40 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:41.355014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-facebf1a-1e08-4c09-9183-becee670052f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:41.355535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-facebf1a-1e08-4c09-9183-becee670052f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:41.361912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-facebf1a-1e08-4c09-9183-becee670052f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:41.362383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-facebf1a-1e08-4c09-9183-becee670052f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:41.363129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-facebf1a-1e08-4c09-9183-becee670052f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:41.363556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-facebf1a-1e08-4c09-9183-becee670052f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:41.427211 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-facebf1a-1e08-4c09-9183-becee670052f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:41.435043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-facebf1a-1e08-4c09-9183-becee670052f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083888 Jun 02 16:36:41.435624 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1108/1979] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:41.696486 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5ace8b86-a2d2-4aa9-8193-26ed50c469b7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:41.697104 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5ace8b86-a2d2-4aa9-8193-26ed50c469b7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:41.703849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5ace8b86-a2d2-4aa9-8193-26ed50c469b7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:41.704295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5ace8b86-a2d2-4aa9-8193-26ed50c469b7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:41.705066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5ace8b86-a2d2-4aa9-8193-26ed50c469b7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:41.705502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5ace8b86-a2d2-4aa9-8193-26ed50c469b7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:41.910965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5ace8b86-a2d2-4aa9-8193-26ed50c469b7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:41.918906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5ace8b86-a2d2-4aa9-8193-26ed50c469b7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.335307 Jun 02 16:36:41.919477 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 872/1980] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:41 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:42.452144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bb4ae346-a853-48aa-aec7-725af0b428d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:42.452695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bb4ae346-a853-48aa-aec7-725af0b428d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:42.459694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb4ae346-a853-48aa-aec7-725af0b428d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:42.460144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb4ae346-a853-48aa-aec7-725af0b428d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:42.460919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb4ae346-a853-48aa-aec7-725af0b428d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:42.461356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bb4ae346-a853-48aa-aec7-725af0b428d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:42.522526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bb4ae346-a853-48aa-aec7-725af0b428d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:42.530847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bb4ae346-a853-48aa-aec7-725af0b428d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082791 Jun 02 16:36:42.531397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1109/1981] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:42.936541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4d0206e1-af9f-4f6f-acbc-d30ae9a882c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:42.937168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4d0206e1-af9f-4f6f-acbc-d30ae9a882c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:42.943674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d0206e1-af9f-4f6f-acbc-d30ae9a882c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:42.944119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d0206e1-af9f-4f6f-acbc-d30ae9a882c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:42.944870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d0206e1-af9f-4f6f-acbc-d30ae9a882c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:42.945298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4d0206e1-af9f-4f6f-acbc-d30ae9a882c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:42.949157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:43.072291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4d0206e1-af9f-4f6f-acbc-d30ae9a882c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:43.081159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4d0206e1-af9f-4f6f-acbc-d30ae9a882c4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148603 Jun 02 16:36:43.081730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 873/1982] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:42 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:43.548889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b9484b0e-a59e-4bb9-8206-dfe1e505be0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:43.549507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b9484b0e-a59e-4bb9-8206-dfe1e505be0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:43.555995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b9484b0e-a59e-4bb9-8206-dfe1e505be0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:43.556449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b9484b0e-a59e-4bb9-8206-dfe1e505be0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:43.557207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b9484b0e-a59e-4bb9-8206-dfe1e505be0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:43.557641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b9484b0e-a59e-4bb9-8206-dfe1e505be0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:43.618064 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b9484b0e-a59e-4bb9-8206-dfe1e505be0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:43.626757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b9484b0e-a59e-4bb9-8206-dfe1e505be0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082696 Jun 02 16:36:43.627319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1110/1983] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:43 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:44.098492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1fb990f6-c126-4b06-aff8-1b73b47885b5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:44.099100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1fb990f6-c126-4b06-aff8-1b73b47885b5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:44.105542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1fb990f6-c126-4b06-aff8-1b73b47885b5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:44.105984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1fb990f6-c126-4b06-aff8-1b73b47885b5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:44.106768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1fb990f6-c126-4b06-aff8-1b73b47885b5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:44.107245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1fb990f6-c126-4b06-aff8-1b73b47885b5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:44.238392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1fb990f6-c126-4b06-aff8-1b73b47885b5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:44.246255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1fb990f6-c126-4b06-aff8-1b73b47885b5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151517 Jun 02 16:36:44.246821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 874/1984] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:44 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:44.643787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-257c60d6-a671-4458-b928-99a1c22600b0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:44.644393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-257c60d6-a671-4458-b928-99a1c22600b0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:44.650662 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257c60d6-a671-4458-b928-99a1c22600b0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:44.651115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257c60d6-a671-4458-b928-99a1c22600b0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:44.651869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257c60d6-a671-4458-b928-99a1c22600b0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:44.652313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-257c60d6-a671-4458-b928-99a1c22600b0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:44.717604 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-257c60d6-a671-4458-b928-99a1c22600b0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:44.725718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-257c60d6-a671-4458-b928-99a1c22600b0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085776 Jun 02 16:36:44.726317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1111/1985] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:44 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:45.264760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-940f7579-fba6-4047-9ab0-1a1d3169782b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:45.265370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-940f7579-fba6-4047-9ab0-1a1d3169782b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:45.267328 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=52 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:45.271978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-940f7579-fba6-4047-9ab0-1a1d3169782b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:45.272422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-940f7579-fba6-4047-9ab0-1a1d3169782b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:45.273214 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-940f7579-fba6-4047-9ab0-1a1d3169782b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:45.273647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-940f7579-fba6-4047-9ab0-1a1d3169782b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:45.404757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-940f7579-fba6-4047-9ab0-1a1d3169782b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:45.412667 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-940f7579-fba6-4047-9ab0-1a1d3169782b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152616 Jun 02 16:36:45.413233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 875/1986] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:45 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:45.743869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7e61dc9a-d34c-4837-be1c-f04e6b72ff71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:45.744479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7e61dc9a-d34c-4837-be1c-f04e6b72ff71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:45.751706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e61dc9a-d34c-4837-be1c-f04e6b72ff71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:45.752151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e61dc9a-d34c-4837-be1c-f04e6b72ff71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:45.752915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e61dc9a-d34c-4837-be1c-f04e6b72ff71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:45.753349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7e61dc9a-d34c-4837-be1c-f04e6b72ff71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:45.818753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7e61dc9a-d34c-4837-be1c-f04e6b72ff71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:45.826708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7e61dc9a-d34c-4837-be1c-f04e6b72ff71 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086692 Jun 02 16:36:45.827263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1112/1987] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:46.429526 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7272bd89-333f-4acf-a270-339a8c4c7d63 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:46.430117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7272bd89-333f-4acf-a270-339a8c4c7d63 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:46.437615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7272bd89-333f-4acf-a270-339a8c4c7d63 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:46.438062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7272bd89-333f-4acf-a270-339a8c4c7d63 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:46.438849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7272bd89-333f-4acf-a270-339a8c4c7d63 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:46.439282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7272bd89-333f-4acf-a270-339a8c4c7d63 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:46.494453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:36:46.494725 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:36:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb (ip 10.222.0.59) !!! Jun 02 16:36:46.567312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7272bd89-333f-4acf-a270-339a8c4c7d63 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:46.575258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7272bd89-333f-4acf-a270-339a8c4c7d63 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149631 Jun 02 16:36:46.575950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 876/1988] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:46 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:46.844555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9655ffe3-1885-402a-9d1e-9b5ee3da9525 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:46.845098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9655ffe3-1885-402a-9d1e-9b5ee3da9525 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:46.847371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=56 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:46.851996 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9655ffe3-1885-402a-9d1e-9b5ee3da9525 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:46.852437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9655ffe3-1885-402a-9d1e-9b5ee3da9525 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:46.853222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9655ffe3-1885-402a-9d1e-9b5ee3da9525 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:46.853618 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9655ffe3-1885-402a-9d1e-9b5ee3da9525 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:46.913886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9655ffe3-1885-402a-9d1e-9b5ee3da9525 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:46.922254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9655ffe3-1885-402a-9d1e-9b5ee3da9525 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082381 Jun 02 16:36:46.922811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1113/1989] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:47.592794 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-99d4ded3-7e63-40d0-a9d4-7757778b5844 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:47.593353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-99d4ded3-7e63-40d0-a9d4-7757778b5844 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:47.599873 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-99d4ded3-7e63-40d0-a9d4-7757778b5844 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:47.600328 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-99d4ded3-7e63-40d0-a9d4-7757778b5844 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:47.601159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-99d4ded3-7e63-40d0-a9d4-7757778b5844 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:47.601596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-99d4ded3-7e63-40d0-a9d4-7757778b5844 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:47.735395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-99d4ded3-7e63-40d0-a9d4-7757778b5844 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:47.743293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-99d4ded3-7e63-40d0-a9d4-7757778b5844 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154810 Jun 02 16:36:47.743863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 877/1990] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:47 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:47.939651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-df18491b-bec3-407f-b99e-35feba55edcf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:47.940299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-df18491b-bec3-407f-b99e-35feba55edcf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:47.947205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df18491b-bec3-407f-b99e-35feba55edcf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:47.947659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df18491b-bec3-407f-b99e-35feba55edcf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:47.948423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df18491b-bec3-407f-b99e-35feba55edcf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:47.948933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-df18491b-bec3-407f-b99e-35feba55edcf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:48.012076 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-df18491b-bec3-407f-b99e-35feba55edcf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:48.021070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-df18491b-bec3-407f-b99e-35feba55edcf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085983 Jun 02 16:36:48.021632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1114/1991] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:47 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:48.760232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0b8719a4-8efd-40d5-b867-d628d6142906 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:48.760851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0b8719a4-8efd-40d5-b867-d628d6142906 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:48.768121 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b8719a4-8efd-40d5-b867-d628d6142906 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:48.768573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b8719a4-8efd-40d5-b867-d628d6142906 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:48.769336 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b8719a4-8efd-40d5-b867-d628d6142906 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:48.769775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b8719a4-8efd-40d5-b867-d628d6142906 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:48.894879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0b8719a4-8efd-40d5-b867-d628d6142906 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:48.902710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0b8719a4-8efd-40d5-b867-d628d6142906 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.146343 Jun 02 16:36:48.903450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 878/1992] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:48 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:49.039275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0e8c48d1-9d16-49b1-b258-6535533746d0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:49.039657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0e8c48d1-9d16-49b1-b258-6535533746d0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:49.045878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e8c48d1-9d16-49b1-b258-6535533746d0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:49.046352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e8c48d1-9d16-49b1-b258-6535533746d0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:49.047103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e8c48d1-9d16-49b1-b258-6535533746d0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:49.047532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e8c48d1-9d16-49b1-b258-6535533746d0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:49.107734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0e8c48d1-9d16-49b1-b258-6535533746d0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:49.115498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0e8c48d1-9d16-49b1-b258-6535533746d0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.080539 Jun 02 16:36:49.116047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1115/1993] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:49.920804 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cde2a1be-555c-451b-b27e-3dcd4285d953 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:49.921419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cde2a1be-555c-451b-b27e-3dcd4285d953 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:49.928058 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cde2a1be-555c-451b-b27e-3dcd4285d953 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:49.928513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cde2a1be-555c-451b-b27e-3dcd4285d953 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:49.929274 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cde2a1be-555c-451b-b27e-3dcd4285d953 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:49.929713 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cde2a1be-555c-451b-b27e-3dcd4285d953 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:50.059205 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cde2a1be-555c-451b-b27e-3dcd4285d953 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:50.067451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cde2a1be-555c-451b-b27e-3dcd4285d953 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151149 Jun 02 16:36:50.067962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 879/1994] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:49 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:50.132811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ec87b238-0fbb-44a1-a547-be9179d69c64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:50.133421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ec87b238-0fbb-44a1-a547-be9179d69c64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:50.140416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ec87b238-0fbb-44a1-a547-be9179d69c64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:50.140861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ec87b238-0fbb-44a1-a547-be9179d69c64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:50.141612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ec87b238-0fbb-44a1-a547-be9179d69c64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:50.142042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ec87b238-0fbb-44a1-a547-be9179d69c64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:50.204765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ec87b238-0fbb-44a1-a547-be9179d69c64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:50.207091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:36:50.213752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ec87b238-0fbb-44a1-a547-be9179d69c64 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084704 Jun 02 16:36:50.214340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1116/1995] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:51.084580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9ff33a0c-c3e2-4f04-b800-2dc996ab01bc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:51.085219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9ff33a0c-c3e2-4f04-b800-2dc996ab01bc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:51.092141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9ff33a0c-c3e2-4f04-b800-2dc996ab01bc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:51.092577 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9ff33a0c-c3e2-4f04-b800-2dc996ab01bc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:51.093328 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9ff33a0c-c3e2-4f04-b800-2dc996ab01bc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:51.093760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9ff33a0c-c3e2-4f04-b800-2dc996ab01bc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:51.221892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9ff33a0c-c3e2-4f04-b800-2dc996ab01bc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:51.229822 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9ff33a0c-c3e2-4f04-b800-2dc996ab01bc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149040 Jun 02 16:36:51.230410 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 880/1996] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:51 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:51.238857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2456e32c-c6f9-4045-92be-18f2454af611 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:51.239464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2456e32c-c6f9-4045-92be-18f2454af611 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:51.245942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2456e32c-c6f9-4045-92be-18f2454af611 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:51.246409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2456e32c-c6f9-4045-92be-18f2454af611 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:51.247210 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2456e32c-c6f9-4045-92be-18f2454af611 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:51.247644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2456e32c-c6f9-4045-92be-18f2454af611 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:51.309715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2456e32c-c6f9-4045-92be-18f2454af611 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:51.317537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2456e32c-c6f9-4045-92be-18f2454af611 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082792 Jun 02 16:36:51.318107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1117/1997] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:52.247509 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-28fa8614-adff-4558-9e52-9230aa9bcaa9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:52.248187 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-28fa8614-adff-4558-9e52-9230aa9bcaa9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:52.254640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28fa8614-adff-4558-9e52-9230aa9bcaa9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:52.255091 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28fa8614-adff-4558-9e52-9230aa9bcaa9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:52.255851 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28fa8614-adff-4558-9e52-9230aa9bcaa9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:52.256286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28fa8614-adff-4558-9e52-9230aa9bcaa9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:52.335123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6079fcd4-0f29-4a1e-b8e7-c798cc006e7f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:52.335515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6079fcd4-0f29-4a1e-b8e7-c798cc006e7f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:52.344784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6079fcd4-0f29-4a1e-b8e7-c798cc006e7f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:52.345238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6079fcd4-0f29-4a1e-b8e7-c798cc006e7f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:52.346040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6079fcd4-0f29-4a1e-b8e7-c798cc006e7f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:52.346515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6079fcd4-0f29-4a1e-b8e7-c798cc006e7f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:52.386587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-28fa8614-adff-4558-9e52-9230aa9bcaa9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:52.395409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-28fa8614-adff-4558-9e52-9230aa9bcaa9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151800 Jun 02 16:36:52.396104 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 881/1998] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:52 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:52.409633 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6079fcd4-0f29-4a1e-b8e7-c798cc006e7f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:52.418040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6079fcd4-0f29-4a1e-b8e7-c798cc006e7f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087008 Jun 02 16:36:52.418641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1118/1999] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:52 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:53.414424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-50173a5e-8a14-43a2-b0c0-5e0ab8b617de tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:53.415037 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-50173a5e-8a14-43a2-b0c0-5e0ab8b617de tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:53.422484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50173a5e-8a14-43a2-b0c0-5e0ab8b617de tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:53.422937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50173a5e-8a14-43a2-b0c0-5e0ab8b617de tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:53.423758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50173a5e-8a14-43a2-b0c0-5e0ab8b617de tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:53.424143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50173a5e-8a14-43a2-b0c0-5e0ab8b617de tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:53.434853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-11df82e4-9258-4a63-a316-5717397e6e0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:53.435470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-11df82e4-9258-4a63-a316-5717397e6e0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:53.441854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11df82e4-9258-4a63-a316-5717397e6e0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:53.442336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11df82e4-9258-4a63-a316-5717397e6e0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:53.443096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11df82e4-9258-4a63-a316-5717397e6e0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:53.443525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11df82e4-9258-4a63-a316-5717397e6e0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:53.505943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-11df82e4-9258-4a63-a316-5717397e6e0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:53.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-11df82e4-9258-4a63-a316-5717397e6e0e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083671 Jun 02 16:36:53.515359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1119/2000] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:53 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:53.558853 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-50173a5e-8a14-43a2-b0c0-5e0ab8b617de tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:53.570265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-50173a5e-8a14-43a2-b0c0-5e0ab8b617de tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.159434 Jun 02 16:36:53.570938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 882/2001] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:53 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:54.531733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2eb3e56e-439a-4960-afc1-38ea51cb6abf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:54.532346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2eb3e56e-439a-4960-afc1-38ea51cb6abf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:54.538933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2eb3e56e-439a-4960-afc1-38ea51cb6abf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:54.539381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2eb3e56e-439a-4960-afc1-38ea51cb6abf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:54.540146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2eb3e56e-439a-4960-afc1-38ea51cb6abf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:54.540590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2eb3e56e-439a-4960-afc1-38ea51cb6abf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:54.587985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-45dacee3-d456-47ad-b0d4-bca07275cee4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:54.588604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-45dacee3-d456-47ad-b0d4-bca07275cee4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:54.595452 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45dacee3-d456-47ad-b0d4-bca07275cee4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:54.595896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45dacee3-d456-47ad-b0d4-bca07275cee4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:54.596779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45dacee3-d456-47ad-b0d4-bca07275cee4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:54.597215 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45dacee3-d456-47ad-b0d4-bca07275cee4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:54.605789 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2eb3e56e-439a-4960-afc1-38ea51cb6abf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:54.614729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2eb3e56e-439a-4960-afc1-38ea51cb6abf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086941 Jun 02 16:36:54.615758 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1120/2002] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:54 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:54.724903 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-45dacee3-d456-47ad-b0d4-bca07275cee4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:54.733254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-45dacee3-d456-47ad-b0d4-bca07275cee4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149464 Jun 02 16:36:54.733753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 883/2003] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:54 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:36:55.632379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e111e6e1-a8b8-4fd1-86a1-77dd0d857115 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:55.632973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e111e6e1-a8b8-4fd1-86a1-77dd0d857115 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:55.640195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e111e6e1-a8b8-4fd1-86a1-77dd0d857115 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:55.640641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e111e6e1-a8b8-4fd1-86a1-77dd0d857115 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:55.641393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e111e6e1-a8b8-4fd1-86a1-77dd0d857115 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:55.641827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e111e6e1-a8b8-4fd1-86a1-77dd0d857115 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:55.703359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e111e6e1-a8b8-4fd1-86a1-77dd0d857115 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:55.711141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e111e6e1-a8b8-4fd1-86a1-77dd0d857115 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082703 Jun 02 16:36:55.711690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1121/2004] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:55.750874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cabb559b-6953-4261-bd72-9adca556fe4e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:55.751483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cabb559b-6953-4261-bd72-9adca556fe4e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:55.757950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cabb559b-6953-4261-bd72-9adca556fe4e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:55.758430 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cabb559b-6953-4261-bd72-9adca556fe4e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:55.759186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cabb559b-6953-4261-bd72-9adca556fe4e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:55.759622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cabb559b-6953-4261-bd72-9adca556fe4e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:55.893518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cabb559b-6953-4261-bd72-9adca556fe4e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:55.901653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cabb559b-6953-4261-bd72-9adca556fe4e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154577 Jun 02 16:36:55.902258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 884/2005] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:55 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:56.728895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-33f30e64-a971-4aef-a6ae-072f307f4eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:56.729520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-33f30e64-a971-4aef-a6ae-072f307f4eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:56.736728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33f30e64-a971-4aef-a6ae-072f307f4eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:56.737247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33f30e64-a971-4aef-a6ae-072f307f4eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:56.738501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33f30e64-a971-4aef-a6ae-072f307f4eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:56.738949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33f30e64-a971-4aef-a6ae-072f307f4eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:56.799317 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-33f30e64-a971-4aef-a6ae-072f307f4eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:56.807160 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-33f30e64-a971-4aef-a6ae-072f307f4eef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082177 Jun 02 16:36:56.807725 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1122/2006] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:56.919591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5b5d3d4d-60a8-4416-b82a-0e06c9b71996 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:56.920199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5b5d3d4d-60a8-4416-b82a-0e06c9b71996 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:56.926717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b5d3d4d-60a8-4416-b82a-0e06c9b71996 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:56.927169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b5d3d4d-60a8-4416-b82a-0e06c9b71996 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:56.927922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b5d3d4d-60a8-4416-b82a-0e06c9b71996 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:56.928381 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5b5d3d4d-60a8-4416-b82a-0e06c9b71996 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:57.056406 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5b5d3d4d-60a8-4416-b82a-0e06c9b71996 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:57.064253 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5b5d3d4d-60a8-4416-b82a-0e06c9b71996 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148563 Jun 02 16:36:57.064816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 885/2007] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:56 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:57.823613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2973bcba-1182-422b-875a-b0f10b474578 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:57.824292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2973bcba-1182-422b-875a-b0f10b474578 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:57.831147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2973bcba-1182-422b-875a-b0f10b474578 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:57.831657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2973bcba-1182-422b-875a-b0f10b474578 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:57.832474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2973bcba-1182-422b-875a-b0f10b474578 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:57.832911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2973bcba-1182-422b-875a-b0f10b474578 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:57.895338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2973bcba-1182-422b-875a-b0f10b474578 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:57.903191 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2973bcba-1182-422b-875a-b0f10b474578 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083452 Jun 02 16:36:57.904645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1123/2008] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:57 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:58.080791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b4010098-39f2-4a45-8319-c3b4eb1f898c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:58.081325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b4010098-39f2-4a45-8319-c3b4eb1f898c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:58.088014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4010098-39f2-4a45-8319-c3b4eb1f898c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:58.088465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4010098-39f2-4a45-8319-c3b4eb1f898c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:58.089220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4010098-39f2-4a45-8319-c3b4eb1f898c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:58.089654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4010098-39f2-4a45-8319-c3b4eb1f898c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:58.216844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b4010098-39f2-4a45-8319-c3b4eb1f898c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:58.224722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b4010098-39f2-4a45-8319-c3b4eb1f898c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.147875 Jun 02 16:36:58.225288 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 886/2009] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:58 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:58.921220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7121e765-1960-4ecd-a63a-256b9dff2358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:58.921823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7121e765-1960-4ecd-a63a-256b9dff2358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:58.928363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7121e765-1960-4ecd-a63a-256b9dff2358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:58.928806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7121e765-1960-4ecd-a63a-256b9dff2358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:58.929554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7121e765-1960-4ecd-a63a-256b9dff2358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:58.929981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7121e765-1960-4ecd-a63a-256b9dff2358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:58.994947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7121e765-1960-4ecd-a63a-256b9dff2358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:59.003577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7121e765-1960-4ecd-a63a-256b9dff2358 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086333 Jun 02 16:36:59.004139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1124/2010] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:58 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:36:59.242346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-40101bee-794f-4d3b-9c73-daed086367e8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:36:59.242977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-40101bee-794f-4d3b-9c73-daed086367e8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:36:59.250097 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40101bee-794f-4d3b-9c73-daed086367e8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:59.250566 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40101bee-794f-4d3b-9c73-daed086367e8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:59.251331 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40101bee-794f-4d3b-9c73-daed086367e8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:36:59.251768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-40101bee-794f-4d3b-9c73-daed086367e8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:36:59.386342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-40101bee-794f-4d3b-9c73-daed086367e8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:36:59.392891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-40101bee-794f-4d3b-9c73-daed086367e8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154451 Jun 02 16:36:59.393453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 887/2011] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:36:59 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:00.020392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-726fdc2c-26a8-4aef-8bdf-aca1ce90e9d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:00.021004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-726fdc2c-26a8-4aef-8bdf-aca1ce90e9d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:00.027385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-726fdc2c-26a8-4aef-8bdf-aca1ce90e9d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:00.027833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-726fdc2c-26a8-4aef-8bdf-aca1ce90e9d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:00.029185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-726fdc2c-26a8-4aef-8bdf-aca1ce90e9d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:00.029619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-726fdc2c-26a8-4aef-8bdf-aca1ce90e9d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:00.090223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-726fdc2c-26a8-4aef-8bdf-aca1ce90e9d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:00.098721 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-726fdc2c-26a8-4aef-8bdf-aca1ce90e9d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082204 Jun 02 16:37:00.099274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1125/2012] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:00.410300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f01b259c-c651-45ac-905d-1c6d62c2e09d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:00.410868 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f01b259c-c651-45ac-905d-1c6d62c2e09d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:00.417373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f01b259c-c651-45ac-905d-1c6d62c2e09d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:00.430911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f01b259c-c651-45ac-905d-1c6d62c2e09d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:00.430911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f01b259c-c651-45ac-905d-1c6d62c2e09d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:00.430911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f01b259c-c651-45ac-905d-1c6d62c2e09d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:00.545698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f01b259c-c651-45ac-905d-1c6d62c2e09d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:00.553910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f01b259c-c651-45ac-905d-1c6d62c2e09d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.147660 Jun 02 16:37:00.554501 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 888/2013] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:00 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:01.115357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-31660f57-e4e2-4338-8859-29ac40840888 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:01.115965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-31660f57-e4e2-4338-8859-29ac40840888 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:01.122887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31660f57-e4e2-4338-8859-29ac40840888 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:01.123466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31660f57-e4e2-4338-8859-29ac40840888 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:01.124218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31660f57-e4e2-4338-8859-29ac40840888 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:01.124647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-31660f57-e4e2-4338-8859-29ac40840888 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:01.186261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-31660f57-e4e2-4338-8859-29ac40840888 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:01.194255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-31660f57-e4e2-4338-8859-29ac40840888 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082640 Jun 02 16:37:01.194818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1126/2014] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:01 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:01.572419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-50ab7e8b-1cf8-47ce-b307-02580dc0c046 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:01.573353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-50ab7e8b-1cf8-47ce-b307-02580dc0c046 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:01.580365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50ab7e8b-1cf8-47ce-b307-02580dc0c046 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:01.581321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50ab7e8b-1cf8-47ce-b307-02580dc0c046 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:01.582129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50ab7e8b-1cf8-47ce-b307-02580dc0c046 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:01.582633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50ab7e8b-1cf8-47ce-b307-02580dc0c046 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:01.719499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-50ab7e8b-1cf8-47ce-b307-02580dc0c046 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:01.721679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:01.728226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-50ab7e8b-1cf8-47ce-b307-02580dc0c046 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.160335 Jun 02 16:37:01.728799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 889/2015] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:01 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:02.211942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-219db93f-e7dd-45d4-ae87-0c0a1215186f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:02.212905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-219db93f-e7dd-45d4-ae87-0c0a1215186f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:02.220281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-219db93f-e7dd-45d4-ae87-0c0a1215186f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:02.220767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-219db93f-e7dd-45d4-ae87-0c0a1215186f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:02.221532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-219db93f-e7dd-45d4-ae87-0c0a1215186f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:02.221972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-219db93f-e7dd-45d4-ae87-0c0a1215186f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:02.283414 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-219db93f-e7dd-45d4-ae87-0c0a1215186f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:02.291261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-219db93f-e7dd-45d4-ae87-0c0a1215186f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083247 Jun 02 16:37:02.291819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1127/2016] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:02.745904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5251fc30-45bb-488e-933f-493c3dfb3646 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:02.746517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5251fc30-45bb-488e-933f-493c3dfb3646 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:02.754015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5251fc30-45bb-488e-933f-493c3dfb3646 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:02.754487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5251fc30-45bb-488e-933f-493c3dfb3646 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:02.755252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5251fc30-45bb-488e-933f-493c3dfb3646 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:02.755677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5251fc30-45bb-488e-933f-493c3dfb3646 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:02.883054 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5251fc30-45bb-488e-933f-493c3dfb3646 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:02.891266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5251fc30-45bb-488e-933f-493c3dfb3646 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149225 Jun 02 16:37:02.891841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 890/2017] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:02 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:03.308488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d0b7e83b-c68d-40aa-8873-e0cd0afd98d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:03.309048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d0b7e83b-c68d-40aa-8873-e0cd0afd98d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:03.315776 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0b7e83b-c68d-40aa-8873-e0cd0afd98d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:03.316233 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0b7e83b-c68d-40aa-8873-e0cd0afd98d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:03.317001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0b7e83b-c68d-40aa-8873-e0cd0afd98d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:03.317450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d0b7e83b-c68d-40aa-8873-e0cd0afd98d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:03.382618 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d0b7e83b-c68d-40aa-8873-e0cd0afd98d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:03.390634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d0b7e83b-c68d-40aa-8873-e0cd0afd98d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086138 Jun 02 16:37:03.391202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1128/2018] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:03 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:03.909056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fbb53503-ac8a-4c7b-aa7d-86be659c1342 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:03.909657 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fbb53503-ac8a-4c7b-aa7d-86be659c1342 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:03.916148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fbb53503-ac8a-4c7b-aa7d-86be659c1342 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:03.916598 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fbb53503-ac8a-4c7b-aa7d-86be659c1342 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:03.917372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fbb53503-ac8a-4c7b-aa7d-86be659c1342 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:03.917813 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fbb53503-ac8a-4c7b-aa7d-86be659c1342 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:04.047466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fbb53503-ac8a-4c7b-aa7d-86be659c1342 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:04.055434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fbb53503-ac8a-4c7b-aa7d-86be659c1342 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150334 Jun 02 16:37:04.055992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 891/2019] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:03 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:37:04.407508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-21d8a3f2-45ad-4d70-9128-0863e5417d7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:04.408125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-21d8a3f2-45ad-4d70-9128-0863e5417d7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:04.414589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21d8a3f2-45ad-4d70-9128-0863e5417d7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:04.415042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21d8a3f2-45ad-4d70-9128-0863e5417d7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:04.415794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21d8a3f2-45ad-4d70-9128-0863e5417d7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:04.416236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21d8a3f2-45ad-4d70-9128-0863e5417d7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:04.479893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-21d8a3f2-45ad-4d70-9128-0863e5417d7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:04.488543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-21d8a3f2-45ad-4d70-9128-0863e5417d7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084994 Jun 02 16:37:04.489109 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1129/2020] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:04 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:05.072640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7ac802bb-adcd-4c25-9e33-5f67eb6b15ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:05.073261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7ac802bb-adcd-4c25-9e33-5f67eb6b15ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:05.080415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ac802bb-adcd-4c25-9e33-5f67eb6b15ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:05.080869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ac802bb-adcd-4c25-9e33-5f67eb6b15ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:05.081642 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ac802bb-adcd-4c25-9e33-5f67eb6b15ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:05.082102 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7ac802bb-adcd-4c25-9e33-5f67eb6b15ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:05.219283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7ac802bb-adcd-4c25-9e33-5f67eb6b15ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:05.227791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7ac802bb-adcd-4c25-9e33-5f67eb6b15ce tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.158975 Jun 02 16:37:05.228579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 892/2021] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:05 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:05.506103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ba3b78e4-7e96-4914-9833-3e3e1f691518 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:05.506713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ba3b78e4-7e96-4914-9833-3e3e1f691518 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:05.513877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ba3b78e4-7e96-4914-9833-3e3e1f691518 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:05.514342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ba3b78e4-7e96-4914-9833-3e3e1f691518 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:05.515102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ba3b78e4-7e96-4914-9833-3e3e1f691518 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:05.515534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ba3b78e4-7e96-4914-9833-3e3e1f691518 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:05.582533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ba3b78e4-7e96-4914-9833-3e3e1f691518 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:05.590929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ba3b78e4-7e96-4914-9833-3e3e1f691518 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.088691 Jun 02 16:37:05.591505 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1130/2022] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:06.244747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bf8aa2a5-3255-49f9-8ad2-1b386a97884c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:06.245356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bf8aa2a5-3255-49f9-8ad2-1b386a97884c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:06.251903 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf8aa2a5-3255-49f9-8ad2-1b386a97884c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:06.252347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf8aa2a5-3255-49f9-8ad2-1b386a97884c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:06.253131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf8aa2a5-3255-49f9-8ad2-1b386a97884c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:06.253559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bf8aa2a5-3255-49f9-8ad2-1b386a97884c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:06.379811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bf8aa2a5-3255-49f9-8ad2-1b386a97884c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:06.387792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bf8aa2a5-3255-49f9-8ad2-1b386a97884c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.146767 Jun 02 16:37:06.388326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 893/2023] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:06 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:06.607141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1c73a8fd-f53c-4586-bbd8-eab20a953412 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:06.607685 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1c73a8fd-f53c-4586-bbd8-eab20a953412 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:06.614263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1c73a8fd-f53c-4586-bbd8-eab20a953412 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:06.614716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1c73a8fd-f53c-4586-bbd8-eab20a953412 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:06.615479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1c73a8fd-f53c-4586-bbd8-eab20a953412 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:06.615917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1c73a8fd-f53c-4586-bbd8-eab20a953412 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:06.676545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1c73a8fd-f53c-4586-bbd8-eab20a953412 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:06.684484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1c73a8fd-f53c-4586-bbd8-eab20a953412 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081313 Jun 02 16:37:06.685203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1131/2024] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:07.404266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-511420fc-5bf2-4ab0-9888-25f319052f71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:07.404814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-511420fc-5bf2-4ab0-9888-25f319052f71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:07.411305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-511420fc-5bf2-4ab0-9888-25f319052f71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:07.411751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-511420fc-5bf2-4ab0-9888-25f319052f71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:07.412507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-511420fc-5bf2-4ab0-9888-25f319052f71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:07.412937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-511420fc-5bf2-4ab0-9888-25f319052f71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:07.547033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-511420fc-5bf2-4ab0-9888-25f319052f71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:07.554871 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-511420fc-5bf2-4ab0-9888-25f319052f71 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154691 Jun 02 16:37:07.555429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 894/2025] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:07 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:07.700794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3119fe62-7fd9-40bc-be02-5534011de0b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:07.703438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3119fe62-7fd9-40bc-be02-5534011de0b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:07.707980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3119fe62-7fd9-40bc-be02-5534011de0b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:07.708434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3119fe62-7fd9-40bc-be02-5534011de0b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:07.709253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3119fe62-7fd9-40bc-be02-5534011de0b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:07.709697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3119fe62-7fd9-40bc-be02-5534011de0b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:07.774226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3119fe62-7fd9-40bc-be02-5534011de0b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:07.782897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3119fe62-7fd9-40bc-be02-5534011de0b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085991 Jun 02 16:37:07.783476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1132/2026] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:08.572305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3615de91-f1a8-4e28-82bc-c589da0091b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:08.572867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3615de91-f1a8-4e28-82bc-c589da0091b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:08.579559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3615de91-f1a8-4e28-82bc-c589da0091b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:08.580001 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3615de91-f1a8-4e28-82bc-c589da0091b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:08.580755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3615de91-f1a8-4e28-82bc-c589da0091b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:08.581185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3615de91-f1a8-4e28-82bc-c589da0091b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:08.709126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3615de91-f1a8-4e28-82bc-c589da0091b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:08.717785 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3615de91-f1a8-4e28-82bc-c589da0091b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149499 Jun 02 16:37:08.718378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 895/2027] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:08 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:08.800615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0571d839-3496-4805-8cd8-631b5a763840 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:08.801238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0571d839-3496-4805-8cd8-631b5a763840 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:08.807664 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0571d839-3496-4805-8cd8-631b5a763840 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:08.808122 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0571d839-3496-4805-8cd8-631b5a763840 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:08.808886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0571d839-3496-4805-8cd8-631b5a763840 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:08.809427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0571d839-3496-4805-8cd8-631b5a763840 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:08.823947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:08.870836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0571d839-3496-4805-8cd8-631b5a763840 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:08.878972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0571d839-3496-4805-8cd8-631b5a763840 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082220 Jun 02 16:37:08.879538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1133/2028] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:08 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:09.734834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3e1b5e1c-aea4-485d-92f8-f75a1b23fc05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:09.735450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3e1b5e1c-aea4-485d-92f8-f75a1b23fc05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:09.742122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e1b5e1c-aea4-485d-92f8-f75a1b23fc05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:09.742565 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e1b5e1c-aea4-485d-92f8-f75a1b23fc05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:09.743322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e1b5e1c-aea4-485d-92f8-f75a1b23fc05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:09.743749 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e1b5e1c-aea4-485d-92f8-f75a1b23fc05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:09.875103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3e1b5e1c-aea4-485d-92f8-f75a1b23fc05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:09.883089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3e1b5e1c-aea4-485d-92f8-f75a1b23fc05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152366 Jun 02 16:37:09.883658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 896/2029] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:09 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:09.896526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f4ab0df2-8adb-4a8b-99d8-74011cea560f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:09.897139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f4ab0df2-8adb-4a8b-99d8-74011cea560f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:09.904933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f4ab0df2-8adb-4a8b-99d8-74011cea560f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:09.905384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f4ab0df2-8adb-4a8b-99d8-74011cea560f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:09.906212 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f4ab0df2-8adb-4a8b-99d8-74011cea560f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:09.906655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f4ab0df2-8adb-4a8b-99d8-74011cea560f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:09.968009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f4ab0df2-8adb-4a8b-99d8-74011cea560f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:09.975927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f4ab0df2-8adb-4a8b-99d8-74011cea560f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083234 Jun 02 16:37:09.976483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1134/2030] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:10.900953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-78119b62-4350-4ad8-8903-7722ccf9c2d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:10.901573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-78119b62-4350-4ad8-8903-7722ccf9c2d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:10.908371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-78119b62-4350-4ad8-8903-7722ccf9c2d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:10.908825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-78119b62-4350-4ad8-8903-7722ccf9c2d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:10.909592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-78119b62-4350-4ad8-8903-7722ccf9c2d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:10.910035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-78119b62-4350-4ad8-8903-7722ccf9c2d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:10.993554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d2de4e9f-9712-45b5-9e32-d62f89b7afe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:10.994204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d2de4e9f-9712-45b5-9e32-d62f89b7afe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:11.001284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2de4e9f-9712-45b5-9e32-d62f89b7afe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:11.001734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2de4e9f-9712-45b5-9e32-d62f89b7afe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:11.002532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2de4e9f-9712-45b5-9e32-d62f89b7afe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:11.002968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2de4e9f-9712-45b5-9e32-d62f89b7afe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:11.039313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-78119b62-4350-4ad8-8903-7722ccf9c2d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:11.047896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-78119b62-4350-4ad8-8903-7722ccf9c2d5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150870 Jun 02 16:37:11.048710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 897/2031] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:10 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:11.065978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d2de4e9f-9712-45b5-9e32-d62f89b7afe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:11.073919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d2de4e9f-9712-45b5-9e32-d62f89b7afe7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084133 Jun 02 16:37:11.074509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1135/2032] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:10 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:37:12.065312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-65e63d35-bcd6-4077-8708-0f8dacd7bcbe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:12.065939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-65e63d35-bcd6-4077-8708-0f8dacd7bcbe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:12.072395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65e63d35-bcd6-4077-8708-0f8dacd7bcbe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:12.072841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65e63d35-bcd6-4077-8708-0f8dacd7bcbe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:12.073603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65e63d35-bcd6-4077-8708-0f8dacd7bcbe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:12.074040 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65e63d35-bcd6-4077-8708-0f8dacd7bcbe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:12.091893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9ac3caa9-5095-4316-a5e7-54d9f8774407 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:12.092544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9ac3caa9-5095-4316-a5e7-54d9f8774407 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:12.098998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ac3caa9-5095-4316-a5e7-54d9f8774407 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:12.099457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ac3caa9-5095-4316-a5e7-54d9f8774407 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:12.100223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ac3caa9-5095-4316-a5e7-54d9f8774407 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:12.100667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9ac3caa9-5095-4316-a5e7-54d9f8774407 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:12.165120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9ac3caa9-5095-4316-a5e7-54d9f8774407 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:12.176670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9ac3caa9-5095-4316-a5e7-54d9f8774407 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.089187 Jun 02 16:37:12.177870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1136/2033] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:37:12.206828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-65e63d35-bcd6-4077-8708-0f8dacd7bcbe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:12.215255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-65e63d35-bcd6-4077-8708-0f8dacd7bcbe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153876 Jun 02 16:37:12.216133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 898/2034] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:12 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:13.194489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dc1df1c3-85ef-424b-8243-5fdf7d3d35a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:13.195106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dc1df1c3-85ef-424b-8243-5fdf7d3d35a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:13.201551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc1df1c3-85ef-424b-8243-5fdf7d3d35a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:13.201997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc1df1c3-85ef-424b-8243-5fdf7d3d35a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:13.202859 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc1df1c3-85ef-424b-8243-5fdf7d3d35a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:13.203293 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc1df1c3-85ef-424b-8243-5fdf7d3d35a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:13.233670 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b078cc6a-8ee0-417e-ba2e-05036013111c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:13.234395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b078cc6a-8ee0-417e-ba2e-05036013111c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:13.240915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b078cc6a-8ee0-417e-ba2e-05036013111c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:13.241374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b078cc6a-8ee0-417e-ba2e-05036013111c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:13.242174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b078cc6a-8ee0-417e-ba2e-05036013111c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:13.242619 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b078cc6a-8ee0-417e-ba2e-05036013111c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:13.265987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-dc1df1c3-85ef-424b-8243-5fdf7d3d35a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:13.274046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dc1df1c3-85ef-424b-8243-5fdf7d3d35a6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083440 Jun 02 16:37:13.274846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1137/2035] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:13 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:13.373587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b078cc6a-8ee0-417e-ba2e-05036013111c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:13.381469 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b078cc6a-8ee0-417e-ba2e-05036013111c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152634 Jun 02 16:37:13.382041 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 899/2036] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:13 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:37:14.292525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-13649a11-9079-43c4-a4dd-4d710ca84356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:14.293141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-13649a11-9079-43c4-a4dd-4d710ca84356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:14.299730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-13649a11-9079-43c4-a4dd-4d710ca84356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:14.300162 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-13649a11-9079-43c4-a4dd-4d710ca84356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:14.300917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-13649a11-9079-43c4-a4dd-4d710ca84356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:14.301353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-13649a11-9079-43c4-a4dd-4d710ca84356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:14.362090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-13649a11-9079-43c4-a4dd-4d710ca84356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:14.369808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-13649a11-9079-43c4-a4dd-4d710ca84356 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081222 Jun 02 16:37:14.370416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1138/2037] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:14.400043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f0f32937-2060-43af-aea8-7f9bd73ed19f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:14.400690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f0f32937-2060-43af-aea8-7f9bd73ed19f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:14.408169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0f32937-2060-43af-aea8-7f9bd73ed19f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:14.408623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0f32937-2060-43af-aea8-7f9bd73ed19f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:14.409390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0f32937-2060-43af-aea8-7f9bd73ed19f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:14.409832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f0f32937-2060-43af-aea8-7f9bd73ed19f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:14.539906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f0f32937-2060-43af-aea8-7f9bd73ed19f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:14.547890 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f0f32937-2060-43af-aea8-7f9bd73ed19f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151729 Jun 02 16:37:14.548460 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 900/2038] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:14 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:15.386760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-491b2d7f-a2c6-45b1-8b46-59f41fc939ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:15.387402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-491b2d7f-a2c6-45b1-8b46-59f41fc939ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:15.393701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-491b2d7f-a2c6-45b1-8b46-59f41fc939ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:15.394207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-491b2d7f-a2c6-45b1-8b46-59f41fc939ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:15.394955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-491b2d7f-a2c6-45b1-8b46-59f41fc939ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:15.395383 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-491b2d7f-a2c6-45b1-8b46-59f41fc939ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:15.455118 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-491b2d7f-a2c6-45b1-8b46-59f41fc939ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:15.463131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-491b2d7f-a2c6-45b1-8b46-59f41fc939ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.080295 Jun 02 16:37:15.463692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1139/2039] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:15 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:15.564776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ee8c5293-1e74-4a26-a24f-f78fb4791555 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:15.565380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ee8c5293-1e74-4a26-a24f-f78fb4791555 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:15.567265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=52 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:15.571941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee8c5293-1e74-4a26-a24f-f78fb4791555 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:15.572392 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee8c5293-1e74-4a26-a24f-f78fb4791555 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:15.573151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee8c5293-1e74-4a26-a24f-f78fb4791555 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:15.573587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee8c5293-1e74-4a26-a24f-f78fb4791555 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:15.705366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ee8c5293-1e74-4a26-a24f-f78fb4791555 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:15.713570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ee8c5293-1e74-4a26-a24f-f78fb4791555 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152803 Jun 02 16:37:15.714149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 901/2040] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:15 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:16.481772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d2f80e97-71a9-4c0c-bb75-8d11c2ca209e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:16.482392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d2f80e97-71a9-4c0c-bb75-8d11c2ca209e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:16.488835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2f80e97-71a9-4c0c-bb75-8d11c2ca209e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:16.489285 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2f80e97-71a9-4c0c-bb75-8d11c2ca209e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:16.490059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2f80e97-71a9-4c0c-bb75-8d11c2ca209e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:16.490514 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d2f80e97-71a9-4c0c-bb75-8d11c2ca209e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:16.556697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d2f80e97-71a9-4c0c-bb75-8d11c2ca209e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:16.565612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d2f80e97-71a9-4c0c-bb75-8d11c2ca209e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.088750 Jun 02 16:37:16.566192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1140/2041] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:16.732103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a6bf8ccb-23ea-49e5-b7d8-17312b278ffe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:16.732652 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a6bf8ccb-23ea-49e5-b7d8-17312b278ffe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:16.739161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a6bf8ccb-23ea-49e5-b7d8-17312b278ffe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:16.739607 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a6bf8ccb-23ea-49e5-b7d8-17312b278ffe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:16.740356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a6bf8ccb-23ea-49e5-b7d8-17312b278ffe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:16.740783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a6bf8ccb-23ea-49e5-b7d8-17312b278ffe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:16.866906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a6bf8ccb-23ea-49e5-b7d8-17312b278ffe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:16.875302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a6bf8ccb-23ea-49e5-b7d8-17312b278ffe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.147808 Jun 02 16:37:16.875874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 902/2042] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:16 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:17.582504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a318cce5-b7a4-4ab9-996c-1799f0fc255d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:17.583124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a318cce5-b7a4-4ab9-996c-1799f0fc255d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:17.585416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=56 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:17.591376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a318cce5-b7a4-4ab9-996c-1799f0fc255d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:17.591831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a318cce5-b7a4-4ab9-996c-1799f0fc255d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:17.592590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a318cce5-b7a4-4ab9-996c-1799f0fc255d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:17.593066 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a318cce5-b7a4-4ab9-996c-1799f0fc255d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:17.893351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c6b573f5-95cb-42b3-b390-0fc8d7db45ae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:17.893924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c6b573f5-95cb-42b3-b390-0fc8d7db45ae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:17.900628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c6b573f5-95cb-42b3-b390-0fc8d7db45ae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:17.900911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a318cce5-b7a4-4ab9-996c-1799f0fc255d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:17.901254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c6b573f5-95cb-42b3-b390-0fc8d7db45ae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:17.902042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c6b573f5-95cb-42b3-b390-0fc8d7db45ae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:17.903497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c6b573f5-95cb-42b3-b390-0fc8d7db45ae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:17.909509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a318cce5-b7a4-4ab9-996c-1799f0fc255d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.330889 Jun 02 16:37:17.910098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1141/2043] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:18.037428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c6b573f5-95cb-42b3-b390-0fc8d7db45ae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:18.045333 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c6b573f5-95cb-42b3-b390-0fc8d7db45ae tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.156138 Jun 02 16:37:18.045900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 903/2044] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:17 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:37:18.926901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-33e9b3ad-d1d8-42e2-aaaf-70369b3aa4e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:18.927512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-33e9b3ad-d1d8-42e2-aaaf-70369b3aa4e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:18.934475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33e9b3ad-d1d8-42e2-aaaf-70369b3aa4e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:18.934917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33e9b3ad-d1d8-42e2-aaaf-70369b3aa4e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:18.935657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33e9b3ad-d1d8-42e2-aaaf-70369b3aa4e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:18.936089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-33e9b3ad-d1d8-42e2-aaaf-70369b3aa4e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:18.996010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-33e9b3ad-d1d8-42e2-aaaf-70369b3aa4e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:19.004303 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-33e9b3ad-d1d8-42e2-aaaf-70369b3aa4e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081247 Jun 02 16:37:19.004866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1142/2045] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:19.063258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-de60da8e-ceca-4432-8ea4-fcac1924ba25 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:19.063878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-de60da8e-ceca-4432-8ea4-fcac1924ba25 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:19.070351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de60da8e-ceca-4432-8ea4-fcac1924ba25 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:19.070802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de60da8e-ceca-4432-8ea4-fcac1924ba25 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:19.071567 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de60da8e-ceca-4432-8ea4-fcac1924ba25 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:19.072009 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de60da8e-ceca-4432-8ea4-fcac1924ba25 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:19.199158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-de60da8e-ceca-4432-8ea4-fcac1924ba25 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:19.207716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-de60da8e-ceca-4432-8ea4-fcac1924ba25 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.148967 Jun 02 16:37:19.208283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 904/2046] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:19 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:20.021659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8427ebf7-6a40-4d6d-82f8-1ae5f11f958f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:20.022308 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8427ebf7-6a40-4d6d-82f8-1ae5f11f958f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:20.029487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8427ebf7-6a40-4d6d-82f8-1ae5f11f958f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:20.029933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8427ebf7-6a40-4d6d-82f8-1ae5f11f958f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:20.030723 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8427ebf7-6a40-4d6d-82f8-1ae5f11f958f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:20.031161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8427ebf7-6a40-4d6d-82f8-1ae5f11f958f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:20.095172 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8427ebf7-6a40-4d6d-82f8-1ae5f11f958f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:20.103107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8427ebf7-6a40-4d6d-82f8-1ae5f11f958f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085325 Jun 02 16:37:20.103674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1143/2047] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:20.225971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c54205bf-f905-4510-8251-a91f0e991120 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:20.226619 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c54205bf-f905-4510-8251-a91f0e991120 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:20.233594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c54205bf-f905-4510-8251-a91f0e991120 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:20.234052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c54205bf-f905-4510-8251-a91f0e991120 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:20.234859 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c54205bf-f905-4510-8251-a91f0e991120 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:20.235303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c54205bf-f905-4510-8251-a91f0e991120 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:20.365773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c54205bf-f905-4510-8251-a91f0e991120 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:20.374046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c54205bf-f905-4510-8251-a91f0e991120 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153011 Jun 02 16:37:20.374739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 905/2048] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:20 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:21.120647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-987d1cd1-e929-4f3e-bef7-41bbb70dd958 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:21.121887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-987d1cd1-e929-4f3e-bef7-41bbb70dd958 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:21.128560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-987d1cd1-e929-4f3e-bef7-41bbb70dd958 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:21.129011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-987d1cd1-e929-4f3e-bef7-41bbb70dd958 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:21.129762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-987d1cd1-e929-4f3e-bef7-41bbb70dd958 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:21.130226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-987d1cd1-e929-4f3e-bef7-41bbb70dd958 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:21.191020 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-987d1cd1-e929-4f3e-bef7-41bbb70dd958 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:21.198872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-987d1cd1-e929-4f3e-bef7-41bbb70dd958 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082099 Jun 02 16:37:21.199515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1144/2049] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:21.391090 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9cf296e0-ae4a-44ee-9407-f161c7d93bbb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:21.391632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9cf296e0-ae4a-44ee-9407-f161c7d93bbb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:21.398195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cf296e0-ae4a-44ee-9407-f161c7d93bbb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:21.398648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cf296e0-ae4a-44ee-9407-f161c7d93bbb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:21.399409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cf296e0-ae4a-44ee-9407-f161c7d93bbb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:21.399847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cf296e0-ae4a-44ee-9407-f161c7d93bbb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:21.416141 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:21.534736 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9cf296e0-ae4a-44ee-9407-f161c7d93bbb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:21.542780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9cf296e0-ae4a-44ee-9407-f161c7d93bbb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.155601 Jun 02 16:37:21.543349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 906/2050] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:21 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:22.216205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0b450e59-54ec-44f4-8d1d-22654520c8e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:22.216954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0b450e59-54ec-44f4-8d1d-22654520c8e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:22.223428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b450e59-54ec-44f4-8d1d-22654520c8e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:22.223873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b450e59-54ec-44f4-8d1d-22654520c8e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:22.224623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b450e59-54ec-44f4-8d1d-22654520c8e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:22.225055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0b450e59-54ec-44f4-8d1d-22654520c8e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:22.287339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0b450e59-54ec-44f4-8d1d-22654520c8e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:22.295609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0b450e59-54ec-44f4-8d1d-22654520c8e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083508 Jun 02 16:37:22.296161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1145/2051] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:22.561688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b333db87-f47a-4260-9511-f9952b10073f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:22.562240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b333db87-f47a-4260-9511-f9952b10073f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:22.568684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b333db87-f47a-4260-9511-f9952b10073f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:22.569135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b333db87-f47a-4260-9511-f9952b10073f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:22.569898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b333db87-f47a-4260-9511-f9952b10073f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:22.570360 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b333db87-f47a-4260-9511-f9952b10073f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:22.703765 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b333db87-f47a-4260-9511-f9952b10073f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:22.711636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b333db87-f47a-4260-9511-f9952b10073f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154507 Jun 02 16:37:22.712447 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 907/2052] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:22 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:23.312978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5bb53266-b925-4631-ac8b-a6333d96d3f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:23.313602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5bb53266-b925-4631-ac8b-a6333d96d3f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:23.320040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5bb53266-b925-4631-ac8b-a6333d96d3f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:23.320504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5bb53266-b925-4631-ac8b-a6333d96d3f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:23.321254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5bb53266-b925-4631-ac8b-a6333d96d3f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:23.321687 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5bb53266-b925-4631-ac8b-a6333d96d3f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:23.382103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5bb53266-b925-4631-ac8b-a6333d96d3f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:23.389924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5bb53266-b925-4631-ac8b-a6333d96d3f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081396 Jun 02 16:37:23.390513 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1146/2053] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:23.729235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7f052c83-7ea9-4944-9391-8c96dd376a74 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:23.729846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7f052c83-7ea9-4944-9391-8c96dd376a74 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:23.736941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f052c83-7ea9-4944-9391-8c96dd376a74 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:23.737382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f052c83-7ea9-4944-9391-8c96dd376a74 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:23.738161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f052c83-7ea9-4944-9391-8c96dd376a74 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:23.738595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7f052c83-7ea9-4944-9391-8c96dd376a74 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:23.867824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7f052c83-7ea9-4944-9391-8c96dd376a74 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:23.876805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7f052c83-7ea9-4944-9391-8c96dd376a74 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.151371 Jun 02 16:37:23.877417 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 908/2054] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:23 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:24.407498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3026f125-825c-4a9c-9c4d-a8abc17d1204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:24.408087 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3026f125-825c-4a9c-9c4d-a8abc17d1204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:24.414501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3026f125-825c-4a9c-9c4d-a8abc17d1204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:24.414955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3026f125-825c-4a9c-9c4d-a8abc17d1204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:24.415708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3026f125-825c-4a9c-9c4d-a8abc17d1204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:24.416140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3026f125-825c-4a9c-9c4d-a8abc17d1204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:24.476833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3026f125-825c-4a9c-9c4d-a8abc17d1204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:24.485261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3026f125-825c-4a9c-9c4d-a8abc17d1204 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082273 Jun 02 16:37:24.485817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1147/2055] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:24.894605 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-371b7b5d-3e64-4787-beb9-21a873bc1d96 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:24.895183 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-371b7b5d-3e64-4787-beb9-21a873bc1d96 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:24.901466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-371b7b5d-3e64-4787-beb9-21a873bc1d96 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:24.901908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-371b7b5d-3e64-4787-beb9-21a873bc1d96 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:24.902696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-371b7b5d-3e64-4787-beb9-21a873bc1d96 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:24.903130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-371b7b5d-3e64-4787-beb9-21a873bc1d96 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:25.031980 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-371b7b5d-3e64-4787-beb9-21a873bc1d96 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:25.039797 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-371b7b5d-3e64-4787-beb9-21a873bc1d96 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149137 Jun 02 16:37:25.040352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 909/2056] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:24 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:25.502364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d9bb1b19-b64d-4582-80ba-fef4bdb51e1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:25.502917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d9bb1b19-b64d-4582-80ba-fef4bdb51e1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:25.509414 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9bb1b19-b64d-4582-80ba-fef4bdb51e1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:25.509864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9bb1b19-b64d-4582-80ba-fef4bdb51e1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:25.510659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9bb1b19-b64d-4582-80ba-fef4bdb51e1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:25.511099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9bb1b19-b64d-4582-80ba-fef4bdb51e1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:25.572155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d9bb1b19-b64d-4582-80ba-fef4bdb51e1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:25.580568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d9bb1b19-b64d-4582-80ba-fef4bdb51e1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082965 Jun 02 16:37:25.581138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1148/2057] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:25 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:26.057707 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-768eb838-65eb-4827-a88b-b7232cdad1d2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:26.058324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-768eb838-65eb-4827-a88b-b7232cdad1d2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:26.065130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-768eb838-65eb-4827-a88b-b7232cdad1d2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:26.065581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-768eb838-65eb-4827-a88b-b7232cdad1d2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:26.066375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-768eb838-65eb-4827-a88b-b7232cdad1d2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:26.066815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-768eb838-65eb-4827-a88b-b7232cdad1d2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:26.196088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-768eb838-65eb-4827-a88b-b7232cdad1d2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:26.204626 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-768eb838-65eb-4827-a88b-b7232cdad1d2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150764 Jun 02 16:37:26.205189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 910/2058] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:26 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:26.598063 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b95ea7b3-d99f-4e06-a492-45a4480ac54b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:26.598705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b95ea7b3-d99f-4e06-a492-45a4480ac54b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:26.605230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b95ea7b3-d99f-4e06-a492-45a4480ac54b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:26.605729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b95ea7b3-d99f-4e06-a492-45a4480ac54b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:26.606529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b95ea7b3-d99f-4e06-a492-45a4480ac54b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:26.606966 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b95ea7b3-d99f-4e06-a492-45a4480ac54b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:26.673130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b95ea7b3-d99f-4e06-a492-45a4480ac54b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:26.681334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b95ea7b3-d99f-4e06-a492-45a4480ac54b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087205 Jun 02 16:37:26.681921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1149/2059] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:27.222530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3e3d58e1-64a4-46d4-abd7-12a0e1ee2633 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:27.223770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3e3d58e1-64a4-46d4-abd7-12a0e1ee2633 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:27.230403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e3d58e1-64a4-46d4-abd7-12a0e1ee2633 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:27.230854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e3d58e1-64a4-46d4-abd7-12a0e1ee2633 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:27.231615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e3d58e1-64a4-46d4-abd7-12a0e1ee2633 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:27.232049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3e3d58e1-64a4-46d4-abd7-12a0e1ee2633 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:27.360374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3e3d58e1-64a4-46d4-abd7-12a0e1ee2633 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:27.368460 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3e3d58e1-64a4-46d4-abd7-12a0e1ee2633 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149726 Jun 02 16:37:27.369033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 911/2060] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:27 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:27.699051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-53e3e987-08ce-478d-9cdf-a75bb8418d63 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:27.699671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-53e3e987-08ce-478d-9cdf-a75bb8418d63 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:27.706457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-53e3e987-08ce-478d-9cdf-a75bb8418d63 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:27.706873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-53e3e987-08ce-478d-9cdf-a75bb8418d63 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:27.707641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-53e3e987-08ce-478d-9cdf-a75bb8418d63 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:27.708075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-53e3e987-08ce-478d-9cdf-a75bb8418d63 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:27.711923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:27.772220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-53e3e987-08ce-478d-9cdf-a75bb8418d63 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:27.780456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-53e3e987-08ce-478d-9cdf-a75bb8418d63 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085278 Jun 02 16:37:27.781027 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1150/2061] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:28.385897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cc13650b-91d0-4cf1-b1ab-9f589744438c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:28.386524 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cc13650b-91d0-4cf1-b1ab-9f589744438c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:28.393007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc13650b-91d0-4cf1-b1ab-9f589744438c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:28.393447 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc13650b-91d0-4cf1-b1ab-9f589744438c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:28.394240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc13650b-91d0-4cf1-b1ab-9f589744438c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:28.394671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cc13650b-91d0-4cf1-b1ab-9f589744438c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:28.521645 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cc13650b-91d0-4cf1-b1ab-9f589744438c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:28.529679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cc13650b-91d0-4cf1-b1ab-9f589744438c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.147603 Jun 02 16:37:28.530280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 912/2062] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:28 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:28.797284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c5061fae-c4f6-4802-9c8f-82d27f44ce9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:28.797825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c5061fae-c4f6-4802-9c8f-82d27f44ce9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:28.804925 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c5061fae-c4f6-4802-9c8f-82d27f44ce9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:28.805378 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c5061fae-c4f6-4802-9c8f-82d27f44ce9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:28.806160 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c5061fae-c4f6-4802-9c8f-82d27f44ce9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:28.806599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c5061fae-c4f6-4802-9c8f-82d27f44ce9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:28.867363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c5061fae-c4f6-4802-9c8f-82d27f44ce9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:28.875352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c5061fae-c4f6-4802-9c8f-82d27f44ce9c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082579 Jun 02 16:37:28.875913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1151/2063] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:29.547021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9c2ffdd5-2701-40d3-803a-fa398008d55d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:29.547630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9c2ffdd5-2701-40d3-803a-fa398008d55d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:29.554053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c2ffdd5-2701-40d3-803a-fa398008d55d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:29.554521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c2ffdd5-2701-40d3-803a-fa398008d55d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:29.555277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c2ffdd5-2701-40d3-803a-fa398008d55d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:29.555708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9c2ffdd5-2701-40d3-803a-fa398008d55d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:29.688262 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9c2ffdd5-2701-40d3-803a-fa398008d55d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:29.696089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9c2ffdd5-2701-40d3-803a-fa398008d55d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153270 Jun 02 16:37:29.696650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 913/2064] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:29 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:29.893119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0f34d530-cd83-460d-9af0-0377107edd1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:29.893670 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0f34d530-cd83-460d-9af0-0377107edd1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:29.900033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f34d530-cd83-460d-9af0-0377107edd1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:29.900476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f34d530-cd83-460d-9af0-0377107edd1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:29.901219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f34d530-cd83-460d-9af0-0377107edd1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:29.901647 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0f34d530-cd83-460d-9af0-0377107edd1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:29.962778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0f34d530-cd83-460d-9af0-0377107edd1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:29.971343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0f34d530-cd83-460d-9af0-0377107edd1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082777 Jun 02 16:37:29.971901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1152/2065] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:30.713421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b5ff5ddc-a477-4e76-97c3-dd2b2552c9b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:30.714126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b5ff5ddc-a477-4e76-97c3-dd2b2552c9b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:30.720669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5ff5ddc-a477-4e76-97c3-dd2b2552c9b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:30.721116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5ff5ddc-a477-4e76-97c3-dd2b2552c9b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:30.721878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5ff5ddc-a477-4e76-97c3-dd2b2552c9b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:30.722345 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b5ff5ddc-a477-4e76-97c3-dd2b2552c9b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:30.851132 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b5ff5ddc-a477-4e76-97c3-dd2b2552c9b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:30.860126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b5ff5ddc-a477-4e76-97c3-dd2b2552c9b4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150837 Jun 02 16:37:30.860699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 914/2066] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:30 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:30.988123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-014f4696-491d-46be-a054-6daf7ae3065e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:30.988659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-014f4696-491d-46be-a054-6daf7ae3065e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:30.995247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-014f4696-491d-46be-a054-6daf7ae3065e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:30.995703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-014f4696-491d-46be-a054-6daf7ae3065e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:30.996464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-014f4696-491d-46be-a054-6daf7ae3065e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:30.996906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-014f4696-491d-46be-a054-6daf7ae3065e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:31.060616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-014f4696-491d-46be-a054-6daf7ae3065e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:31.068413 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-014f4696-491d-46be-a054-6daf7ae3065e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084263 Jun 02 16:37:31.068974 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1153/2067] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:31.877122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1b849c46-9eb6-44b5-afb9-bd19cae0215d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:31.877741 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1b849c46-9eb6-44b5-afb9-bd19cae0215d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:31.884295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b849c46-9eb6-44b5-afb9-bd19cae0215d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:31.884748 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b849c46-9eb6-44b5-afb9-bd19cae0215d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:31.885510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b849c46-9eb6-44b5-afb9-bd19cae0215d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:31.885952 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1b849c46-9eb6-44b5-afb9-bd19cae0215d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:32.019000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1b849c46-9eb6-44b5-afb9-bd19cae0215d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:32.026920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1b849c46-9eb6-44b5-afb9-bd19cae0215d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.154265 Jun 02 16:37:32.027483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 915/2068] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:31 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:32.085159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-872e47dc-88aa-4ae0-bc9c-93cc928e2f28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:32.085834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-872e47dc-88aa-4ae0-bc9c-93cc928e2f28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:32.093312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-872e47dc-88aa-4ae0-bc9c-93cc928e2f28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:32.093767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-872e47dc-88aa-4ae0-bc9c-93cc928e2f28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:32.094563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-872e47dc-88aa-4ae0-bc9c-93cc928e2f28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:32.095005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-872e47dc-88aa-4ae0-bc9c-93cc928e2f28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:32.156328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-872e47dc-88aa-4ae0-bc9c-93cc928e2f28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:32.164409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-872e47dc-88aa-4ae0-bc9c-93cc928e2f28 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083141 Jun 02 16:37:32.170489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1154/2069] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:33.045972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cfc6a93d-3a5c-43e4-9511-c1ce78d4789a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:33.046620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cfc6a93d-3a5c-43e4-9511-c1ce78d4789a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:33.053251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfc6a93d-3a5c-43e4-9511-c1ce78d4789a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:33.053702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfc6a93d-3a5c-43e4-9511-c1ce78d4789a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:33.054503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfc6a93d-3a5c-43e4-9511-c1ce78d4789a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:33.054945 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cfc6a93d-3a5c-43e4-9511-c1ce78d4789a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:33.182036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a253227b-960b-4795-a71c-4ccf0bc9c921 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:33.182678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a253227b-960b-4795-a71c-4ccf0bc9c921 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:33.184216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cfc6a93d-3a5c-43e4-9511-c1ce78d4789a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:33.189351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a253227b-960b-4795-a71c-4ccf0bc9c921 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:33.196467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a253227b-960b-4795-a71c-4ccf0bc9c921 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:33.196467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a253227b-960b-4795-a71c-4ccf0bc9c921 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:33.196467 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a253227b-960b-4795-a71c-4ccf0bc9c921 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:33.196817 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cfc6a93d-3a5c-43e4-9511-c1ce78d4789a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152360 Jun 02 16:37:33.196817 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 916/2070] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:33 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:33.254261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a253227b-960b-4795-a71c-4ccf0bc9c921 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:33.262204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a253227b-960b-4795-a71c-4ccf0bc9c921 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084062 Jun 02 16:37:33.262765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1155/2071] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:37:34.212884 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-54b452cb-b102-44b0-a818-9593f2e5f5d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:34.213535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-54b452cb-b102-44b0-a818-9593f2e5f5d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:34.221131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-54b452cb-b102-44b0-a818-9593f2e5f5d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:34.221582 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-54b452cb-b102-44b0-a818-9593f2e5f5d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:34.222381 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-54b452cb-b102-44b0-a818-9593f2e5f5d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:34.222824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-54b452cb-b102-44b0-a818-9593f2e5f5d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:34.280572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9b72a2c9-7e6a-46b8-8c9b-2989a0b9d472 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:34.281216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9b72a2c9-7e6a-46b8-8c9b-2989a0b9d472 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:34.287695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b72a2c9-7e6a-46b8-8c9b-2989a0b9d472 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:34.288153 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b72a2c9-7e6a-46b8-8c9b-2989a0b9d472 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:34.288906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b72a2c9-7e6a-46b8-8c9b-2989a0b9d472 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:34.289339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b72a2c9-7e6a-46b8-8c9b-2989a0b9d472 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:34.352288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9b72a2c9-7e6a-46b8-8c9b-2989a0b9d472 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:34.353792 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-54b452cb-b102-44b0-a818-9593f2e5f5d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:34.360545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9b72a2c9-7e6a-46b8-8c9b-2989a0b9d472 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084593 Jun 02 16:37:34.361110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1156/2072] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:34.361794 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-54b452cb-b102-44b0-a818-9593f2e5f5d7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153031 Jun 02 16:37:34.362385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 917/2073] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:34 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:35.378103 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-482abc26-f7d1-4933-be18-206f40d72eb7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:35.378672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-275a7696-515b-453f-b3d7-7161727c04fe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:35.379057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-482abc26-f7d1-4933-be18-206f40d72eb7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:35.379184 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-275a7696-515b-453f-b3d7-7161727c04fe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:35.385138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-482abc26-f7d1-4933-be18-206f40d72eb7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:35.385538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-275a7696-515b-453f-b3d7-7161727c04fe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:35.385663 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-482abc26-f7d1-4933-be18-206f40d72eb7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:35.385993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-275a7696-515b-453f-b3d7-7161727c04fe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:35.386373 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-482abc26-f7d1-4933-be18-206f40d72eb7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:35.386780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-275a7696-515b-453f-b3d7-7161727c04fe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:35.386888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-482abc26-f7d1-4933-be18-206f40d72eb7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:35.387216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-275a7696-515b-453f-b3d7-7161727c04fe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:35.452255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-482abc26-f7d1-4933-be18-206f40d72eb7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:35.460451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-482abc26-f7d1-4933-be18-206f40d72eb7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086424 Jun 02 16:37:35.461017 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1157/2074] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:35 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:35.520130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-275a7696-515b-453f-b3d7-7161727c04fe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:35.528039 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-275a7696-515b-453f-b3d7-7161727c04fe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.153373 Jun 02 16:37:35.529489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 918/2075] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:35 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:37:36.477823 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b422debe-404c-4aed-b8e5-1c9e02e6ce91 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:36.478433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b422debe-404c-4aed-b8e5-1c9e02e6ce91 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:36.485763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b422debe-404c-4aed-b8e5-1c9e02e6ce91 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:36.486250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b422debe-404c-4aed-b8e5-1c9e02e6ce91 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:36.487007 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b422debe-404c-4aed-b8e5-1c9e02e6ce91 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:36.487449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b422debe-404c-4aed-b8e5-1c9e02e6ce91 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:36.545625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0ed9e4b9-dbaa-4f0d-8131-cd236993e792 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:36.546326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0ed9e4b9-dbaa-4f0d-8131-cd236993e792 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:36.548955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b422debe-404c-4aed-b8e5-1c9e02e6ce91 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:36.552898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0ed9e4b9-dbaa-4f0d-8131-cd236993e792 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:36.553346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0ed9e4b9-dbaa-4f0d-8131-cd236993e792 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:36.554144 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0ed9e4b9-dbaa-4f0d-8131-cd236993e792 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:36.554592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0ed9e4b9-dbaa-4f0d-8131-cd236993e792 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:36.556831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b422debe-404c-4aed-b8e5-1c9e02e6ce91 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083013 Jun 02 16:37:36.557609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1158/2076] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:36 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:36.682577 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0ed9e4b9-dbaa-4f0d-8131-cd236993e792 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:36.690725 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0ed9e4b9-dbaa-4f0d-8131-cd236993e792 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.149694 Jun 02 16:37:36.692258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 919/2077] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:36 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:37:37.573848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eb057ab2-ac93-49fe-87eb-411216c2da16 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:37.574501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eb057ab2-ac93-49fe-87eb-411216c2da16 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:37.582159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb057ab2-ac93-49fe-87eb-411216c2da16 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:37.582614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb057ab2-ac93-49fe-87eb-411216c2da16 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:37.583434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb057ab2-ac93-49fe-87eb-411216c2da16 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:37.583877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eb057ab2-ac93-49fe-87eb-411216c2da16 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:37.646597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-eb057ab2-ac93-49fe-87eb-411216c2da16 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:37.654476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eb057ab2-ac93-49fe-87eb-411216c2da16 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084555 Jun 02 16:37:37.655489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1159/2078] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:37 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:37.708753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-904342c7-9bab-49ff-8d3e-64d19efa2b73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:37.709417 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-904342c7-9bab-49ff-8d3e-64d19efa2b73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:37.717191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-904342c7-9bab-49ff-8d3e-64d19efa2b73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:37.717820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-904342c7-9bab-49ff-8d3e-64d19efa2b73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:37.718654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-904342c7-9bab-49ff-8d3e-64d19efa2b73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:37.719119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-904342c7-9bab-49ff-8d3e-64d19efa2b73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:37.853219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-904342c7-9bab-49ff-8d3e-64d19efa2b73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:37.861644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-904342c7-9bab-49ff-8d3e-64d19efa2b73 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.156834 Jun 02 16:37:37.862234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 920/2079] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:37 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:38.672199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-21cbe8d6-e7aa-4fc1-9e8e-ffe0ca7f0c39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:38.672808 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-21cbe8d6-e7aa-4fc1-9e8e-ffe0ca7f0c39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:38.679256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21cbe8d6-e7aa-4fc1-9e8e-ffe0ca7f0c39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:38.679706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21cbe8d6-e7aa-4fc1-9e8e-ffe0ca7f0c39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:38.680461 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21cbe8d6-e7aa-4fc1-9e8e-ffe0ca7f0c39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:38.680897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21cbe8d6-e7aa-4fc1-9e8e-ffe0ca7f0c39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:38.741679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-21cbe8d6-e7aa-4fc1-9e8e-ffe0ca7f0c39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:38.750532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-21cbe8d6-e7aa-4fc1-9e8e-ffe0ca7f0c39 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082633 Jun 02 16:37:38.751098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1160/2080] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:38 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:38.878694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-212640e9-06dd-485e-9ee1-d3cd75783d3f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:38.879314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-212640e9-06dd-485e-9ee1-d3cd75783d3f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:38.885755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-212640e9-06dd-485e-9ee1-d3cd75783d3f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:38.886232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-212640e9-06dd-485e-9ee1-d3cd75783d3f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:38.886992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-212640e9-06dd-485e-9ee1-d3cd75783d3f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:38.887420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-212640e9-06dd-485e-9ee1-d3cd75783d3f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:39.014617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-212640e9-06dd-485e-9ee1-d3cd75783d3f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:39.022506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-212640e9-06dd-485e-9ee1-d3cd75783d3f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.147731 Jun 02 16:37:39.023070 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 921/2081] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:38 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:39.768511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c5c14796-6d24-4713-a80b-75637038cfe4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:39.769117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c5c14796-6d24-4713-a80b-75637038cfe4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:39.775613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c5c14796-6d24-4713-a80b-75637038cfe4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:39.776063 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c5c14796-6d24-4713-a80b-75637038cfe4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:39.776814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c5c14796-6d24-4713-a80b-75637038cfe4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:39.777250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c5c14796-6d24-4713-a80b-75637038cfe4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:39.840441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c5c14796-6d24-4713-a80b-75637038cfe4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:39.849043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c5c14796-6d24-4713-a80b-75637038cfe4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085248 Jun 02 16:37:39.849596 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1161/2082] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:40.040674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ef8660bb-beda-41de-a435-6e6d8d4c23fa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:40.041207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ef8660bb-beda-41de-a435-6e6d8d4c23fa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:40.048082 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef8660bb-beda-41de-a435-6e6d8d4c23fa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:40.048570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef8660bb-beda-41de-a435-6e6d8d4c23fa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:40.049377 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef8660bb-beda-41de-a435-6e6d8d4c23fa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:40.049819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef8660bb-beda-41de-a435-6e6d8d4c23fa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:40.179106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ef8660bb-beda-41de-a435-6e6d8d4c23fa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:40.187708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ef8660bb-beda-41de-a435-6e6d8d4c23fa tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150933 Jun 02 16:37:40.188281 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 922/2083] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:40 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:40.866341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-89de02a2-9ad0-4c12-ba75-c67b7485b1d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:40.866947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-89de02a2-9ad0-4c12-ba75-c67b7485b1d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:40.873478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89de02a2-9ad0-4c12-ba75-c67b7485b1d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:40.873916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89de02a2-9ad0-4c12-ba75-c67b7485b1d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:40.874689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89de02a2-9ad0-4c12-ba75-c67b7485b1d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:40.875115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89de02a2-9ad0-4c12-ba75-c67b7485b1d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:40.937171 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-89de02a2-9ad0-4c12-ba75-c67b7485b1d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:40.944992 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-89de02a2-9ad0-4c12-ba75-c67b7485b1d3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082500 Jun 02 16:37:40.945541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1162/2084] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:41.204558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-06885f51-94a5-48cc-9779-fb29f88979d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:41.205171 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-06885f51-94a5-48cc-9779-fb29f88979d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:41.212710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06885f51-94a5-48cc-9779-fb29f88979d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:41.213164 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06885f51-94a5-48cc-9779-fb29f88979d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:41.213929 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06885f51-94a5-48cc-9779-fb29f88979d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:41.214400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-06885f51-94a5-48cc-9779-fb29f88979d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:41.218380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:41.345119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-06885f51-94a5-48cc-9779-fb29f88979d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:41.353235 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-06885f51-94a5-48cc-9779-fb29f88979d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.152516 Jun 02 16:37:41.353808 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 923/2085] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:41 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:41.962589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-75866e46-4484-4f46-afec-5c80ef305c67 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:41.963182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-75866e46-4484-4f46-afec-5c80ef305c67 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:41.970583 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75866e46-4484-4f46-afec-5c80ef305c67 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:41.971038 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75866e46-4484-4f46-afec-5c80ef305c67 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:41.971809 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75866e46-4484-4f46-afec-5c80ef305c67 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:41.972249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-75866e46-4484-4f46-afec-5c80ef305c67 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:42.032652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-75866e46-4484-4f46-afec-5c80ef305c67 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:42.040525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-75866e46-4484-4f46-afec-5c80ef305c67 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082067 Jun 02 16:37:42.041081 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1163/2086] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:42.371394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-65214c40-daf7-4695-89d4-81abbaea4061 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:42.372014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-65214c40-daf7-4695-89d4-81abbaea4061 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:42.378784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65214c40-daf7-4695-89d4-81abbaea4061 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:42.379245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65214c40-daf7-4695-89d4-81abbaea4061 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:42.380006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65214c40-daf7-4695-89d4-81abbaea4061 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:42.380443 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65214c40-daf7-4695-89d4-81abbaea4061 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:42.509516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-65214c40-daf7-4695-89d4-81abbaea4061 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:42.517937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-65214c40-daf7-4695-89d4-81abbaea4061 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.150392 Jun 02 16:37:42.518527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 924/2087] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:42 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:43.057963 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8ceba33c-8068-437e-bf3d-ab0488faa391 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:43.058610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8ceba33c-8068-437e-bf3d-ab0488faa391 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:43.065365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ceba33c-8068-437e-bf3d-ab0488faa391 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:43.065814 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ceba33c-8068-437e-bf3d-ab0488faa391 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:43.066606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ceba33c-8068-437e-bf3d-ab0488faa391 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:43.067048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ceba33c-8068-437e-bf3d-ab0488faa391 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:43.135849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8ceba33c-8068-437e-bf3d-ab0488faa391 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:43.137468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8ceba33c-8068-437e-bf3d-ab0488faa391 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083392 Jun 02 16:37:43.138030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1164/2088] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:43 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:43.535624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9d16964a-96c2-4d14-9510-c9c06bd63233 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:43.536230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9d16964a-96c2-4d14-9510-c9c06bd63233 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:43.543016 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d16964a-96c2-4d14-9510-c9c06bd63233 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:43.543473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d16964a-96c2-4d14-9510-c9c06bd63233 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:43.544242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d16964a-96c2-4d14-9510-c9c06bd63233 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:43.544685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d16964a-96c2-4d14-9510-c9c06bd63233 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:43.710993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9d16964a-96c2-4d14-9510-c9c06bd63233 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:43.720606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9d16964a-96c2-4d14-9510-c9c06bd63233 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1560 microversion: 2.1 time: 0.188947 Jun 02 16:37:43.721168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 925/2089] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:43 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:44.154744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-316d6902-6a1a-4adb-81f6-65dff96cf6d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:44.155352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-316d6902-6a1a-4adb-81f6-65dff96cf6d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:44.161744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-316d6902-6a1a-4adb-81f6-65dff96cf6d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:44.162224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-316d6902-6a1a-4adb-81f6-65dff96cf6d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:44.162984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-316d6902-6a1a-4adb-81f6-65dff96cf6d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:44.163412 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-316d6902-6a1a-4adb-81f6-65dff96cf6d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:44.269279 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-316d6902-6a1a-4adb-81f6-65dff96cf6d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:44.278185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-316d6902-6a1a-4adb-81f6-65dff96cf6d7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.127220 Jun 02 16:37:44.278886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1165/2090] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:44 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:44.737379 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e04e7cff-22c9-4c6a-a215-8df3cd669eec tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:44.738000 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e04e7cff-22c9-4c6a-a215-8df3cd669eec tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:44.745092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e04e7cff-22c9-4c6a-a215-8df3cd669eec tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:44.745643 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e04e7cff-22c9-4c6a-a215-8df3cd669eec tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:44.746513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e04e7cff-22c9-4c6a-a215-8df3cd669eec tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:44.746983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e04e7cff-22c9-4c6a-a215-8df3cd669eec tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:45.004290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e04e7cff-22c9-4c6a-a215-8df3cd669eec tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:45.018162 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e04e7cff-22c9-4c6a-a215-8df3cd669eec tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1518 microversion: 2.1 time: 0.284958 Jun 02 16:37:45.018392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-92fa43dd-8e3d-41e9-8199-180ad867a850 req-d17a7a5b-e576-4159-ada5-3adc205a5038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9f21d8-cd12-4d8c-8dc7-765453991dcb", "name": "network-vif-deleted", "tag": "72896168-abc4-4538-b499-5f8549bf384e"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:37:45.019454 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 926/2091] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:44 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1518 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:45.026264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-92fa43dd-8e3d-41e9-8199-180ad867a850 req-d17a7a5b-e576-4159-ada5-3adc205a5038 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:45.032601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-92fa43dd-8e3d-41e9-8199-180ad867a850 req-d17a7a5b-e576-4159-ada5-3adc205a5038 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:45.038081 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-92fa43dd-8e3d-41e9-8199-180ad867a850 req-d17a7a5b-e576-4159-ada5-3adc205a5038 service nova] Creating event network-vif-deleted:72896168-abc4-4538-b499-5f8549bf384e for instance 6d9f21d8-cd12-4d8c-8dc7-765453991dcb on hv-cinder-79760 Jun 02 16:37:45.043186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-92fa43dd-8e3d-41e9-8199-180ad867a850 req-d17a7a5b-e576-4159-ada5-3adc205a5038 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029084 Jun 02 16:37:45.043784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1166/2092] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:37:45.294134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-6ae3bd5e-b097-4c37-a09f-efdffb8474b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:45.295307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-6ae3bd5e-b097-4c37-a09f-efdffb8474b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:45.301376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6ae3bd5e-b097-4c37-a09f-efdffb8474b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:45.301824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6ae3bd5e-b097-4c37-a09f-efdffb8474b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:45.302615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6ae3bd5e-b097-4c37-a09f-efdffb8474b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:45.303050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-6ae3bd5e-b097-4c37-a09f-efdffb8474b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:45.366289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-6ae3bd5e-b097-4c37-a09f-efdffb8474b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:45.375323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-6ae3bd5e-b097-4c37-a09f-efdffb8474b6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084983 Jun 02 16:37:45.375901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 927/2093] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:46.036640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f1704be1-bcbd-45ce-8622-19e15129f41e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:46.037291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f1704be1-bcbd-45ce-8622-19e15129f41e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:46.043512 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1704be1-bcbd-45ce-8622-19e15129f41e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:46.043961 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1704be1-bcbd-45ce-8622-19e15129f41e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:46.045334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1704be1-bcbd-45ce-8622-19e15129f41e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:46.046157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1704be1-bcbd-45ce-8622-19e15129f41e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:46.063873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:46.115096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f1704be1-bcbd-45ce-8622-19e15129f41e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:46.123559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f1704be1-bcbd-45ce-8622-19e15129f41e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.091038 Jun 02 16:37:46.124487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1167/2094] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:46 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:46.392581 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1ff08e0a-1e13-4cbe-97bb-6e7ccf8dfe61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:46.393153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1ff08e0a-1e13-4cbe-97bb-6e7ccf8dfe61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:46.395648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=54 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:46.400644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ff08e0a-1e13-4cbe-97bb-6e7ccf8dfe61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:46.401096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ff08e0a-1e13-4cbe-97bb-6e7ccf8dfe61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:46.401862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ff08e0a-1e13-4cbe-97bb-6e7ccf8dfe61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:46.402332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1ff08e0a-1e13-4cbe-97bb-6e7ccf8dfe61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:46.466273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1ff08e0a-1e13-4cbe-97bb-6e7ccf8dfe61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:46.474511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1ff08e0a-1e13-4cbe-97bb-6e7ccf8dfe61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086389 Jun 02 16:37:46.475077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 928/2095] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:47.140848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-70b7feab-bfe1-41b1-90c5-f83ff4f673d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:47.141491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-70b7feab-bfe1-41b1-90c5-f83ff4f673d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:47.147973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70b7feab-bfe1-41b1-90c5-f83ff4f673d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:47.148428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70b7feab-bfe1-41b1-90c5-f83ff4f673d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:47.149182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70b7feab-bfe1-41b1-90c5-f83ff4f673d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:47.149622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70b7feab-bfe1-41b1-90c5-f83ff4f673d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:47.209825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-70b7feab-bfe1-41b1-90c5-f83ff4f673d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:47.221100 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-70b7feab-bfe1-41b1-90c5-f83ff4f673d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084183 Jun 02 16:37:47.221672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1168/2096] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:47 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:47.491478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-42de9c85-f8c7-4d87-a4f3-2f91e99f5973 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:47.492098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-42de9c85-f8c7-4d87-a4f3-2f91e99f5973 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:47.498659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-42de9c85-f8c7-4d87-a4f3-2f91e99f5973 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:47.499117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-42de9c85-f8c7-4d87-a4f3-2f91e99f5973 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:47.499857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-42de9c85-f8c7-4d87-a4f3-2f91e99f5973 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:47.500296 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-42de9c85-f8c7-4d87-a4f3-2f91e99f5973 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:47.561691 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-42de9c85-f8c7-4d87-a4f3-2f91e99f5973 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:47.569846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-42de9c85-f8c7-4d87-a4f3-2f91e99f5973 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082185 Jun 02 16:37:47.575066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 929/2097] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:47 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:48.238105 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-62e1ede9-64d0-40fa-9001-a4b06f3a4578 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:48.238712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-62e1ede9-64d0-40fa-9001-a4b06f3a4578 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:48.240970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=56 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:48.245616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62e1ede9-64d0-40fa-9001-a4b06f3a4578 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:48.246058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62e1ede9-64d0-40fa-9001-a4b06f3a4578 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:48.246834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62e1ede9-64d0-40fa-9001-a4b06f3a4578 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:48.247267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-62e1ede9-64d0-40fa-9001-a4b06f3a4578 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:48.310837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-62e1ede9-64d0-40fa-9001-a4b06f3a4578 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:48.318593 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-62e1ede9-64d0-40fa-9001-a4b06f3a4578 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084301 Jun 02 16:37:48.319151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1169/2098] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:48 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:48.588423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c8583a72-21bd-4273-90b8-a0abac1c24e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:48.588973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c8583a72-21bd-4273-90b8-a0abac1c24e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:48.595679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8583a72-21bd-4273-90b8-a0abac1c24e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:48.596128 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8583a72-21bd-4273-90b8-a0abac1c24e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:48.596898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8583a72-21bd-4273-90b8-a0abac1c24e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:48.597336 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8583a72-21bd-4273-90b8-a0abac1c24e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:48.658243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c8583a72-21bd-4273-90b8-a0abac1c24e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:48.666111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c8583a72-21bd-4273-90b8-a0abac1c24e2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081925 Jun 02 16:37:48.666679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 930/2099] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:48 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:49.335733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-59bce046-14a7-4cfa-a16a-83b9e125db7f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:49.336351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-59bce046-14a7-4cfa-a16a-83b9e125db7f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:49.343731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59bce046-14a7-4cfa-a16a-83b9e125db7f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:49.344180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59bce046-14a7-4cfa-a16a-83b9e125db7f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:49.344937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59bce046-14a7-4cfa-a16a-83b9e125db7f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:49.345371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59bce046-14a7-4cfa-a16a-83b9e125db7f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:49.405131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-59bce046-14a7-4cfa-a16a-83b9e125db7f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:49.413004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-59bce046-14a7-4cfa-a16a-83b9e125db7f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081098 Jun 02 16:37:49.413560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1170/2100] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:49 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:49.682857 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-94bf71a9-f47d-495f-b9c9-ab68db2740ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:49.683465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-94bf71a9-f47d-495f-b9c9-ab68db2740ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:49.690002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-94bf71a9-f47d-495f-b9c9-ab68db2740ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:49.690476 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-94bf71a9-f47d-495f-b9c9-ab68db2740ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:49.691226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-94bf71a9-f47d-495f-b9c9-ab68db2740ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:49.691656 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-94bf71a9-f47d-495f-b9c9-ab68db2740ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:49.751867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-94bf71a9-f47d-495f-b9c9-ab68db2740ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:49.759623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-94bf71a9-f47d-495f-b9c9-ab68db2740ca tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.080609 Jun 02 16:37:49.760188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 931/2101] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:50.429623 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-24ad8b11-b1fc-4d75-8737-d65914af45f6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:50.430205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-24ad8b11-b1fc-4d75-8737-d65914af45f6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:50.437259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24ad8b11-b1fc-4d75-8737-d65914af45f6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:50.437705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24ad8b11-b1fc-4d75-8737-d65914af45f6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:50.438514 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24ad8b11-b1fc-4d75-8737-d65914af45f6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:50.438934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-24ad8b11-b1fc-4d75-8737-d65914af45f6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:50.502722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-24ad8b11-b1fc-4d75-8737-d65914af45f6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:50.510631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-24ad8b11-b1fc-4d75-8737-d65914af45f6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084940 Jun 02 16:37:50.511194 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1171/2102] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:50 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:50.776761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a5d2912b-ba8a-4c91-9e9d-4012a4a439c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:50.777309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a5d2912b-ba8a-4c91-9e9d-4012a4a439c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:50.784312 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5d2912b-ba8a-4c91-9e9d-4012a4a439c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:50.784755 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5d2912b-ba8a-4c91-9e9d-4012a4a439c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:50.785515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5d2912b-ba8a-4c91-9e9d-4012a4a439c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:50.785955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5d2912b-ba8a-4c91-9e9d-4012a4a439c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:50.850404 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a5d2912b-ba8a-4c91-9e9d-4012a4a439c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:50.858834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a5d2912b-ba8a-4c91-9e9d-4012a4a439c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086000 Jun 02 16:37:50.859378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 932/2103] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:51.528359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0c21e483-310d-4863-937a-8c3c171ca6c8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:51.529646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0c21e483-310d-4863-937a-8c3c171ca6c8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:51.535658 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c21e483-310d-4863-937a-8c3c171ca6c8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:51.536114 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c21e483-310d-4863-937a-8c3c171ca6c8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:51.536874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c21e483-310d-4863-937a-8c3c171ca6c8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:51.537318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0c21e483-310d-4863-937a-8c3c171ca6c8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:51.600031 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0c21e483-310d-4863-937a-8c3c171ca6c8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:51.608264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0c21e483-310d-4863-937a-8c3c171ca6c8 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083766 Jun 02 16:37:51.608844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1172/2104] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:51 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:51.876546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b452edd7-69ae-46fa-9cd1-42bd7d79a3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:51.877077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b452edd7-69ae-46fa-9cd1-42bd7d79a3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:51.883589 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b452edd7-69ae-46fa-9cd1-42bd7d79a3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:51.884048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b452edd7-69ae-46fa-9cd1-42bd7d79a3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:51.884813 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b452edd7-69ae-46fa-9cd1-42bd7d79a3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:51.885256 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b452edd7-69ae-46fa-9cd1-42bd7d79a3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:51.949700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b452edd7-69ae-46fa-9cd1-42bd7d79a3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:51.958200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b452edd7-69ae-46fa-9cd1-42bd7d79a3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086368 Jun 02 16:37:51.958834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 933/2105] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:52.625318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-de45b435-93aa-4e0d-bf95-6b010af84f13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:52.625914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-de45b435-93aa-4e0d-bf95-6b010af84f13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:52.632551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-de45b435-93aa-4e0d-bf95-6b010af84f13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:52.633000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-de45b435-93aa-4e0d-bf95-6b010af84f13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:52.633754 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-de45b435-93aa-4e0d-bf95-6b010af84f13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:52.634225 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-de45b435-93aa-4e0d-bf95-6b010af84f13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:52.694457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-de45b435-93aa-4e0d-bf95-6b010af84f13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:52.703033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-de45b435-93aa-4e0d-bf95-6b010af84f13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081733 Jun 02 16:37:52.703598 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1173/2106] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:52 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:52.976366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8a35a566-8781-419d-9aa4-3701d4a83dfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:52.976989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8a35a566-8781-419d-9aa4-3701d4a83dfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:52.984340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a35a566-8781-419d-9aa4-3701d4a83dfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:52.984787 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a35a566-8781-419d-9aa4-3701d4a83dfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:52.985552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a35a566-8781-419d-9aa4-3701d4a83dfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:52.985984 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a35a566-8781-419d-9aa4-3701d4a83dfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:53.046770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8a35a566-8781-419d-9aa4-3701d4a83dfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:53.054621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8a35a566-8781-419d-9aa4-3701d4a83dfc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082624 Jun 02 16:37:53.055178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 934/2107] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:52 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:53.720732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-49eb4311-1eb8-4b54-bcf0-e408db47d3af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:53.721358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-49eb4311-1eb8-4b54-bcf0-e408db47d3af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:53.727843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-49eb4311-1eb8-4b54-bcf0-e408db47d3af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:53.728295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-49eb4311-1eb8-4b54-bcf0-e408db47d3af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:53.729065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-49eb4311-1eb8-4b54-bcf0-e408db47d3af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:53.729501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-49eb4311-1eb8-4b54-bcf0-e408db47d3af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:53.790304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-49eb4311-1eb8-4b54-bcf0-e408db47d3af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:53.798342 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-49eb4311-1eb8-4b54-bcf0-e408db47d3af tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082105 Jun 02 16:37:53.798916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1174/2108] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:53 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:54.072240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4fa8aa4a-6145-43d0-b1fc-a44c4cc3f7ae tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:54.072882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4fa8aa4a-6145-43d0-b1fc-a44c4cc3f7ae tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:54.079188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4fa8aa4a-6145-43d0-b1fc-a44c4cc3f7ae tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:54.079632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4fa8aa4a-6145-43d0-b1fc-a44c4cc3f7ae tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:54.080382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4fa8aa4a-6145-43d0-b1fc-a44c4cc3f7ae tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:54.080813 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4fa8aa4a-6145-43d0-b1fc-a44c4cc3f7ae tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:54.141635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4fa8aa4a-6145-43d0-b1fc-a44c4cc3f7ae tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:54.149465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4fa8aa4a-6145-43d0-b1fc-a44c4cc3f7ae tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081129 Jun 02 16:37:54.150019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 935/2109] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:54 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:54.816000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d6575c14-0dc9-41f5-930c-41fa04c0104f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:54.816584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d6575c14-0dc9-41f5-930c-41fa04c0104f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:54.823018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d6575c14-0dc9-41f5-930c-41fa04c0104f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:54.823458 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d6575c14-0dc9-41f5-930c-41fa04c0104f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:54.824205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d6575c14-0dc9-41f5-930c-41fa04c0104f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:54.824635 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d6575c14-0dc9-41f5-930c-41fa04c0104f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:54.889706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d6575c14-0dc9-41f5-930c-41fa04c0104f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:54.897581 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d6575c14-0dc9-41f5-930c-41fa04c0104f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.085682 Jun 02 16:37:54.898229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1175/2110] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:54 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:55.166101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-493c2337-0da2-4cf4-a367-2906115d8007 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:55.166717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-493c2337-0da2-4cf4-a367-2906115d8007 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:55.173969 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-493c2337-0da2-4cf4-a367-2906115d8007 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:55.174441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-493c2337-0da2-4cf4-a367-2906115d8007 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:55.175202 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-493c2337-0da2-4cf4-a367-2906115d8007 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:55.175630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-493c2337-0da2-4cf4-a367-2906115d8007 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:55.240811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-493c2337-0da2-4cf4-a367-2906115d8007 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:55.249457 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-493c2337-0da2-4cf4-a367-2906115d8007 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087183 Jun 02 16:37:55.250011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 936/2111] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:55.914221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8631aa95-40b5-45e7-8df2-a7196002d3a5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:55.914833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8631aa95-40b5-45e7-8df2-a7196002d3a5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:55.921351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8631aa95-40b5-45e7-8df2-a7196002d3a5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:55.921801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8631aa95-40b5-45e7-8df2-a7196002d3a5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:55.922588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8631aa95-40b5-45e7-8df2-a7196002d3a5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:55.923025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8631aa95-40b5-45e7-8df2-a7196002d3a5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:55.986197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8631aa95-40b5-45e7-8df2-a7196002d3a5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:55.994028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8631aa95-40b5-45e7-8df2-a7196002d3a5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083720 Jun 02 16:37:55.994617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1176/2112] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:55 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:56.267234 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-200fc56e-01bf-4074-8be3-351bdc28d0ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:56.267862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-200fc56e-01bf-4074-8be3-351bdc28d0ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:56.274474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-200fc56e-01bf-4074-8be3-351bdc28d0ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:56.274926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-200fc56e-01bf-4074-8be3-351bdc28d0ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:56.275681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-200fc56e-01bf-4074-8be3-351bdc28d0ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:56.276115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-200fc56e-01bf-4074-8be3-351bdc28d0ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:56.336319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-200fc56e-01bf-4074-8be3-351bdc28d0ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:56.344420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-200fc56e-01bf-4074-8be3-351bdc28d0ad tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082098 Jun 02 16:37:56.344981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 937/2113] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:57.011424 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2ce58160-771d-4f35-8bf9-99ddc1069bfd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:57.012079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2ce58160-771d-4f35-8bf9-99ddc1069bfd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:57.019201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ce58160-771d-4f35-8bf9-99ddc1069bfd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:57.019657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ce58160-771d-4f35-8bf9-99ddc1069bfd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:57.020418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ce58160-771d-4f35-8bf9-99ddc1069bfd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:57.020898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ce58160-771d-4f35-8bf9-99ddc1069bfd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:57.083370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2ce58160-771d-4f35-8bf9-99ddc1069bfd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:57.092481 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2ce58160-771d-4f35-8bf9-99ddc1069bfd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084901 Jun 02 16:37:57.093041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1177/2114] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:57 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:57.361473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3965cf14-0491-4762-bef1-e029e8036177 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:57.362021 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3965cf14-0491-4762-bef1-e029e8036177 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:57.368625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3965cf14-0491-4762-bef1-e029e8036177 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:57.369081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3965cf14-0491-4762-bef1-e029e8036177 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:57.369850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3965cf14-0491-4762-bef1-e029e8036177 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:57.370323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3965cf14-0491-4762-bef1-e029e8036177 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:57.430674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3965cf14-0491-4762-bef1-e029e8036177 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:57.438978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3965cf14-0491-4762-bef1-e029e8036177 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081414 Jun 02 16:37:57.439541 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 938/2115] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:57 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:58.109614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-78525d74-d3b6-4762-a01f-afbe622db7d4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:58.110196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-78525d74-d3b6-4762-a01f-afbe622db7d4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:58.116659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78525d74-d3b6-4762-a01f-afbe622db7d4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:58.117110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78525d74-d3b6-4762-a01f-afbe622db7d4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:58.117867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78525d74-d3b6-4762-a01f-afbe622db7d4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:58.118331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-78525d74-d3b6-4762-a01f-afbe622db7d4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:58.179161 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-78525d74-d3b6-4762-a01f-afbe622db7d4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:58.187499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-78525d74-d3b6-4762-a01f-afbe622db7d4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081927 Jun 02 16:37:58.188060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1178/2116] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:58 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:37:58.456782 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e76ab6c3-7750-426e-b0db-5633fb4bef32 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:58.457433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e76ab6c3-7750-426e-b0db-5633fb4bef32 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:58.464189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e76ab6c3-7750-426e-b0db-5633fb4bef32 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:58.464639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e76ab6c3-7750-426e-b0db-5633fb4bef32 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:58.465404 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e76ab6c3-7750-426e-b0db-5633fb4bef32 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:58.465957 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e76ab6c3-7750-426e-b0db-5633fb4bef32 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:58.529119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e76ab6c3-7750-426e-b0db-5633fb4bef32 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:58.531306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:37:58.537514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e76ab6c3-7750-426e-b0db-5633fb4bef32 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084608 Jun 02 16:37:58.538099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 939/2117] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:58 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:59.204620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e833e5e0-b34b-4f7c-920a-9d226da2f64d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:59.205225 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e833e5e0-b34b-4f7c-920a-9d226da2f64d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:59.211188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e833e5e0-b34b-4f7c-920a-9d226da2f64d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:59.211631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e833e5e0-b34b-4f7c-920a-9d226da2f64d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:59.212630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e833e5e0-b34b-4f7c-920a-9d226da2f64d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:59.213060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e833e5e0-b34b-4f7c-920a-9d226da2f64d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:59.276170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e833e5e0-b34b-4f7c-920a-9d226da2f64d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:59.284692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e833e5e0-b34b-4f7c-920a-9d226da2f64d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084552 Jun 02 16:37:59.285265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1179/2118] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:59 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:37:59.554957 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fd338604-e2c2-4a71-a712-bb6f37143458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:37:59.555613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fd338604-e2c2-4a71-a712-bb6f37143458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:37:59.562559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd338604-e2c2-4a71-a712-bb6f37143458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:59.563012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd338604-e2c2-4a71-a712-bb6f37143458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:59.563781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd338604-e2c2-4a71-a712-bb6f37143458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:37:59.564221 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fd338604-e2c2-4a71-a712-bb6f37143458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:37:59.628955 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fd338604-e2c2-4a71-a712-bb6f37143458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:37:59.636875 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fd338604-e2c2-4a71-a712-bb6f37143458 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086137 Jun 02 16:37:59.637446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 940/2119] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:37:59 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:00.301820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-413011e6-c5bf-4973-bdf0-368f477721ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:00.302465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-413011e6-c5bf-4973-bdf0-368f477721ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:00.308891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-413011e6-c5bf-4973-bdf0-368f477721ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:00.309345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-413011e6-c5bf-4973-bdf0-368f477721ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:00.311079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-413011e6-c5bf-4973-bdf0-368f477721ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:00.311522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-413011e6-c5bf-4973-bdf0-368f477721ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:00.372651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-413011e6-c5bf-4973-bdf0-368f477721ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:00.380732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-413011e6-c5bf-4973-bdf0-368f477721ef tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082825 Jun 02 16:38:00.385345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1180/2120] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:00 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:00.655319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-11f4c336-327d-43e0-97bf-092aa92e8d06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:00.655904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-11f4c336-327d-43e0-97bf-092aa92e8d06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:00.662368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11f4c336-327d-43e0-97bf-092aa92e8d06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:00.662821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11f4c336-327d-43e0-97bf-092aa92e8d06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:00.663587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11f4c336-327d-43e0-97bf-092aa92e8d06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:00.664027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11f4c336-327d-43e0-97bf-092aa92e8d06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:00.725257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-11f4c336-327d-43e0-97bf-092aa92e8d06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:00.733968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-11f4c336-327d-43e0-97bf-092aa92e8d06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083221 Jun 02 16:38:00.734567 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 941/2121] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:01.397619 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0768454c-f065-44c0-9e83-5d77d253a6a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:01.398182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0768454c-f065-44c0-9e83-5d77d253a6a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:01.404721 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0768454c-f065-44c0-9e83-5d77d253a6a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:01.405163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0768454c-f065-44c0-9e83-5d77d253a6a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:01.405908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0768454c-f065-44c0-9e83-5d77d253a6a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:01.406368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0768454c-f065-44c0-9e83-5d77d253a6a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:01.466304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0768454c-f065-44c0-9e83-5d77d253a6a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:01.474142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0768454c-f065-44c0-9e83-5d77d253a6a0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.080403 Jun 02 16:38:01.474705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1181/2122] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:01 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:38:01.751356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-eaee35e0-d3e1-4e68-945c-5ca08cd4de03 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:01.751977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-eaee35e0-d3e1-4e68-945c-5ca08cd4de03 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:01.758346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eaee35e0-d3e1-4e68-945c-5ca08cd4de03 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:01.758793 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eaee35e0-d3e1-4e68-945c-5ca08cd4de03 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:01.759539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eaee35e0-d3e1-4e68-945c-5ca08cd4de03 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:01.759971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eaee35e0-d3e1-4e68-945c-5ca08cd4de03 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:01.820905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eaee35e0-d3e1-4e68-945c-5ca08cd4de03 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:01.828683 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-eaee35e0-d3e1-4e68-945c-5ca08cd4de03 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081732 Jun 02 16:38:01.829238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 942/2123] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:01 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:02.490972 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-68ab9e3c-bcd1-4109-b9c2-4d3fc0ae5893 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:02.491524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-68ab9e3c-bcd1-4109-b9c2-4d3fc0ae5893 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:02.497983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68ab9e3c-bcd1-4109-b9c2-4d3fc0ae5893 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:02.498460 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68ab9e3c-bcd1-4109-b9c2-4d3fc0ae5893 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:02.499215 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68ab9e3c-bcd1-4109-b9c2-4d3fc0ae5893 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:02.499644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68ab9e3c-bcd1-4109-b9c2-4d3fc0ae5893 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:02.562567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-68ab9e3c-bcd1-4109-b9c2-4d3fc0ae5893 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:02.570595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-68ab9e3c-bcd1-4109-b9c2-4d3fc0ae5893 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083543 Jun 02 16:38:02.571155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1182/2124] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:02 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:02.846094 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-41b52636-ab3c-456e-98f2-63d515a7cf23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:02.846650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-41b52636-ab3c-456e-98f2-63d515a7cf23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:02.853132 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41b52636-ab3c-456e-98f2-63d515a7cf23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:02.853584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41b52636-ab3c-456e-98f2-63d515a7cf23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:02.854381 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41b52636-ab3c-456e-98f2-63d515a7cf23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:02.854823 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41b52636-ab3c-456e-98f2-63d515a7cf23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:02.917956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-41b52636-ab3c-456e-98f2-63d515a7cf23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:02.926053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-41b52636-ab3c-456e-98f2-63d515a7cf23 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084029 Jun 02 16:38:02.926641 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 943/2125] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:03.588416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-219ebfea-9d13-4a39-a12c-14d1ec4c5d5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:03.588968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-219ebfea-9d13-4a39-a12c-14d1ec4c5d5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:03.596005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-219ebfea-9d13-4a39-a12c-14d1ec4c5d5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:03.596459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-219ebfea-9d13-4a39-a12c-14d1ec4c5d5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:03.597220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-219ebfea-9d13-4a39-a12c-14d1ec4c5d5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:03.597666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-219ebfea-9d13-4a39-a12c-14d1ec4c5d5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:03.661401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-219ebfea-9d13-4a39-a12c-14d1ec4c5d5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:03.669370 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-219ebfea-9d13-4a39-a12c-14d1ec4c5d5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.085140 Jun 02 16:38:03.669936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1183/2126] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:03 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:03.943132 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-768691d1-1078-4aa4-9e70-b2791ad9944d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:03.943770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-768691d1-1078-4aa4-9e70-b2791ad9944d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:03.950335 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-768691d1-1078-4aa4-9e70-b2791ad9944d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:03.950779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-768691d1-1078-4aa4-9e70-b2791ad9944d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:03.951535 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-768691d1-1078-4aa4-9e70-b2791ad9944d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:03.951962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-768691d1-1078-4aa4-9e70-b2791ad9944d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:04.014842 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-768691d1-1078-4aa4-9e70-b2791ad9944d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:04.022647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-768691d1-1078-4aa4-9e70-b2791ad9944d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083297 Jun 02 16:38:04.023207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 944/2127] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:03 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:04.686554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-70a9793c-8adf-4c65-baae-fa9824fa7618 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:04.687163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-70a9793c-8adf-4c65-baae-fa9824fa7618 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:04.693705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70a9793c-8adf-4c65-baae-fa9824fa7618 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:04.694200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70a9793c-8adf-4c65-baae-fa9824fa7618 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:04.694973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70a9793c-8adf-4c65-baae-fa9824fa7618 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:04.695415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-70a9793c-8adf-4c65-baae-fa9824fa7618 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:04.699379 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:04.758123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-70a9793c-8adf-4c65-baae-fa9824fa7618 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:04.766926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-70a9793c-8adf-4c65-baae-fa9824fa7618 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084530 Jun 02 16:38:04.767620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1184/2128] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:04 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:05.039621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2ad774c1-6cf4-4e13-87f1-284cc931002e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:05.040170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2ad774c1-6cf4-4e13-87f1-284cc931002e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:05.047358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ad774c1-6cf4-4e13-87f1-284cc931002e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:05.047803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ad774c1-6cf4-4e13-87f1-284cc931002e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:05.048560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ad774c1-6cf4-4e13-87f1-284cc931002e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:05.048991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2ad774c1-6cf4-4e13-87f1-284cc931002e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:05.110658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2ad774c1-6cf4-4e13-87f1-284cc931002e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:05.118517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2ad774c1-6cf4-4e13-87f1-284cc931002e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082783 Jun 02 16:38:05.119074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 945/2129] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:05.783493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6a2fc88c-c6ff-447b-a2a0-a3918092a22e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:05.784115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6a2fc88c-c6ff-447b-a2a0-a3918092a22e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:05.790476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a2fc88c-c6ff-447b-a2a0-a3918092a22e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:05.791679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a2fc88c-c6ff-447b-a2a0-a3918092a22e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:05.791679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a2fc88c-c6ff-447b-a2a0-a3918092a22e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:05.792150 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6a2fc88c-c6ff-447b-a2a0-a3918092a22e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:05.853032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6a2fc88c-c6ff-447b-a2a0-a3918092a22e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:05.861148 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6a2fc88c-c6ff-447b-a2a0-a3918092a22e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081487 Jun 02 16:38:05.861700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1185/2130] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:05 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:06.135378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c2c23229-ccff-47f2-8b0b-4d717f0e3bfe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:06.135926 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c2c23229-ccff-47f2-8b0b-4d717f0e3bfe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:06.143110 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c2c23229-ccff-47f2-8b0b-4d717f0e3bfe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:06.143557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c2c23229-ccff-47f2-8b0b-4d717f0e3bfe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:06.144319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c2c23229-ccff-47f2-8b0b-4d717f0e3bfe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:06.144749 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c2c23229-ccff-47f2-8b0b-4d717f0e3bfe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:06.211990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c2c23229-ccff-47f2-8b0b-4d717f0e3bfe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:06.220075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c2c23229-ccff-47f2-8b0b-4d717f0e3bfe tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.088626 Jun 02 16:38:06.220635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 946/2131] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:06.878511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f7e83a07-3cb9-4b5e-94ff-2c2bdb6afe03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:06.879129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f7e83a07-3cb9-4b5e-94ff-2c2bdb6afe03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:06.885638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e83a07-3cb9-4b5e-94ff-2c2bdb6afe03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:06.886110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e83a07-3cb9-4b5e-94ff-2c2bdb6afe03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:06.886871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e83a07-3cb9-4b5e-94ff-2c2bdb6afe03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:06.887936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e83a07-3cb9-4b5e-94ff-2c2bdb6afe03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:06.949063 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f7e83a07-3cb9-4b5e-94ff-2c2bdb6afe03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:06.957005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f7e83a07-3cb9-4b5e-94ff-2c2bdb6afe03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082312 Jun 02 16:38:06.957561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1186/2132] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:06 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:07.241122 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d7335e7b-360d-482d-9fca-139d659cab31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:07.241749 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d7335e7b-360d-482d-9fca-139d659cab31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:07.248637 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7335e7b-360d-482d-9fca-139d659cab31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:07.249091 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7335e7b-360d-482d-9fca-139d659cab31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:07.249864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7335e7b-360d-482d-9fca-139d659cab31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:07.250335 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7335e7b-360d-482d-9fca-139d659cab31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:07.311071 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d7335e7b-360d-482d-9fca-139d659cab31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:07.319126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d7335e7b-360d-482d-9fca-139d659cab31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084940 Jun 02 16:38:07.319689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 947/2133] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:07.974387 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-99e0cd02-1067-42f9-a7cc-39576ff2a24c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:07.974938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-99e0cd02-1067-42f9-a7cc-39576ff2a24c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:07.981587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-99e0cd02-1067-42f9-a7cc-39576ff2a24c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:07.982036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-99e0cd02-1067-42f9-a7cc-39576ff2a24c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:07.982818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-99e0cd02-1067-42f9-a7cc-39576ff2a24c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:07.983252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-99e0cd02-1067-42f9-a7cc-39576ff2a24c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:08.047368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-99e0cd02-1067-42f9-a7cc-39576ff2a24c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:08.055181 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-99e0cd02-1067-42f9-a7cc-39576ff2a24c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084792 Jun 02 16:38:08.055742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1187/2134] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:07 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:08.336054 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-381750f2-08d8-4891-85bf-be07507b393a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:08.336862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-381750f2-08d8-4891-85bf-be07507b393a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:08.343366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381750f2-08d8-4891-85bf-be07507b393a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:08.343816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381750f2-08d8-4891-85bf-be07507b393a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:08.344579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381750f2-08d8-4891-85bf-be07507b393a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:08.345013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-381750f2-08d8-4891-85bf-be07507b393a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:08.408121 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-381750f2-08d8-4891-85bf-be07507b393a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:08.415928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-381750f2-08d8-4891-85bf-be07507b393a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083873 Jun 02 16:38:08.416484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 948/2135] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:08 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:09.072253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-675eeca9-8ccd-4889-8cdc-7f673d487981 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:09.072873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-675eeca9-8ccd-4889-8cdc-7f673d487981 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:09.079729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-675eeca9-8ccd-4889-8cdc-7f673d487981 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:09.080185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-675eeca9-8ccd-4889-8cdc-7f673d487981 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:09.080948 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-675eeca9-8ccd-4889-8cdc-7f673d487981 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:09.081391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-675eeca9-8ccd-4889-8cdc-7f673d487981 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:09.142618 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-675eeca9-8ccd-4889-8cdc-7f673d487981 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:09.150446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-675eeca9-8ccd-4889-8cdc-7f673d487981 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082026 Jun 02 16:38:09.151011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1188/2136] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:09 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:09.433103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b4706f23-3e2f-414f-9334-ee4c0382a212 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:09.433720 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b4706f23-3e2f-414f-9334-ee4c0382a212 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:09.440337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4706f23-3e2f-414f-9334-ee4c0382a212 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:09.440784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4706f23-3e2f-414f-9334-ee4c0382a212 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:09.441545 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4706f23-3e2f-414f-9334-ee4c0382a212 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:09.441978 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b4706f23-3e2f-414f-9334-ee4c0382a212 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:09.503226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b4706f23-3e2f-414f-9334-ee4c0382a212 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:09.511123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b4706f23-3e2f-414f-9334-ee4c0382a212 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081894 Jun 02 16:38:09.511679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 949/2137] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:10.168600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-38dddc1e-e2ec-4709-8fe1-14b1e50f1eb6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:10.169289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-38dddc1e-e2ec-4709-8fe1-14b1e50f1eb6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:10.175750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38dddc1e-e2ec-4709-8fe1-14b1e50f1eb6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:10.178602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38dddc1e-e2ec-4709-8fe1-14b1e50f1eb6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:10.178602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38dddc1e-e2ec-4709-8fe1-14b1e50f1eb6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:10.178602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-38dddc1e-e2ec-4709-8fe1-14b1e50f1eb6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:10.241757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-38dddc1e-e2ec-4709-8fe1-14b1e50f1eb6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:10.252613 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-38dddc1e-e2ec-4709-8fe1-14b1e50f1eb6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.087862 Jun 02 16:38:10.253185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1189/2138] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:10 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:10.528654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-754cf3b1-55aa-4eb3-a739-b0e9a5cad3bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:10.529267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-754cf3b1-55aa-4eb3-a739-b0e9a5cad3bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:10.535797 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-754cf3b1-55aa-4eb3-a739-b0e9a5cad3bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:10.536247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-754cf3b1-55aa-4eb3-a739-b0e9a5cad3bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:10.536991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-754cf3b1-55aa-4eb3-a739-b0e9a5cad3bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:10.537421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-754cf3b1-55aa-4eb3-a739-b0e9a5cad3bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:10.598243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-754cf3b1-55aa-4eb3-a739-b0e9a5cad3bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:10.606382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-754cf3b1-55aa-4eb3-a739-b0e9a5cad3bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081553 Jun 02 16:38:10.606942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 950/2139] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:10 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:11.269399 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8cf954b3-1975-48f6-bac4-3e27c517607b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:11.270052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8cf954b3-1975-48f6-bac4-3e27c517607b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:11.276496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8cf954b3-1975-48f6-bac4-3e27c517607b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:11.276949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8cf954b3-1975-48f6-bac4-3e27c517607b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:11.278433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8cf954b3-1975-48f6-bac4-3e27c517607b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:11.278897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8cf954b3-1975-48f6-bac4-3e27c517607b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:11.339395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8cf954b3-1975-48f6-bac4-3e27c517607b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:11.347975 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8cf954b3-1975-48f6-bac4-3e27c517607b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082388 Jun 02 16:38:11.348535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1190/2140] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:11 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:11.623440 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-73a29f22-d21e-4b17-a90b-f805d4d1e2cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:11.623988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-73a29f22-d21e-4b17-a90b-f805d4d1e2cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:11.630478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-73a29f22-d21e-4b17-a90b-f805d4d1e2cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:11.630927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-73a29f22-d21e-4b17-a90b-f805d4d1e2cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:11.631688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-73a29f22-d21e-4b17-a90b-f805d4d1e2cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:11.632129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-73a29f22-d21e-4b17-a90b-f805d4d1e2cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:11.693230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-73a29f22-d21e-4b17-a90b-f805d4d1e2cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:11.701746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-73a29f22-d21e-4b17-a90b-f805d4d1e2cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082443 Jun 02 16:38:11.702353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 951/2141] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:11 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:12.365260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-26ac35ce-24c4-4904-a79e-f3ab55a6b7c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:12.365873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-26ac35ce-24c4-4904-a79e-f3ab55a6b7c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:12.373051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-26ac35ce-24c4-4904-a79e-f3ab55a6b7c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:12.373477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-26ac35ce-24c4-4904-a79e-f3ab55a6b7c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:12.374269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-26ac35ce-24c4-4904-a79e-f3ab55a6b7c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:12.374709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-26ac35ce-24c4-4904-a79e-f3ab55a6b7c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:12.442251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-26ac35ce-24c4-4904-a79e-f3ab55a6b7c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:12.451257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-26ac35ce-24c4-4904-a79e-f3ab55a6b7c7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.089843 Jun 02 16:38:12.451824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1191/2142] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:12 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:12.719409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-619b0d66-1276-4098-b247-1f772a1f10ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:12.719979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-619b0d66-1276-4098-b247-1f772a1f10ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:12.726388 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-619b0d66-1276-4098-b247-1f772a1f10ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:12.726838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-619b0d66-1276-4098-b247-1f772a1f10ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:12.727600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-619b0d66-1276-4098-b247-1f772a1f10ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:12.728033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-619b0d66-1276-4098-b247-1f772a1f10ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:12.794759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-619b0d66-1276-4098-b247-1f772a1f10ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:12.802690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-619b0d66-1276-4098-b247-1f772a1f10ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087711 Jun 02 16:38:12.803258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 952/2143] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:13.468656 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e90b6624-d703-4937-8516-9cb18f09c360 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:13.469254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e90b6624-d703-4937-8516-9cb18f09c360 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:13.476030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e90b6624-d703-4937-8516-9cb18f09c360 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:13.476490 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e90b6624-d703-4937-8516-9cb18f09c360 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:13.477248 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e90b6624-d703-4937-8516-9cb18f09c360 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:13.477675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e90b6624-d703-4937-8516-9cb18f09c360 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:13.540579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e90b6624-d703-4937-8516-9cb18f09c360 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:13.548773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e90b6624-d703-4937-8516-9cb18f09c360 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084102 Jun 02 16:38:13.549339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1192/2144] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:13 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:13.819728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d60b125f-3b94-49d6-8ebf-047e32b07a73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:13.820283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d60b125f-3b94-49d6-8ebf-047e32b07a73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:13.826731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d60b125f-3b94-49d6-8ebf-047e32b07a73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:13.827178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d60b125f-3b94-49d6-8ebf-047e32b07a73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:13.827943 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d60b125f-3b94-49d6-8ebf-047e32b07a73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:13.828371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d60b125f-3b94-49d6-8ebf-047e32b07a73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:13.890575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d60b125f-3b94-49d6-8ebf-047e32b07a73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:13.902582 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d60b125f-3b94-49d6-8ebf-047e32b07a73 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086725 Jun 02 16:38:13.903419 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 953/2145] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:13 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:14.565030 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-315924e8-11fd-438e-8aba-480e1c23f961 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:14.565593 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-315924e8-11fd-438e-8aba-480e1c23f961 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:14.571715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-315924e8-11fd-438e-8aba-480e1c23f961 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:14.572169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-315924e8-11fd-438e-8aba-480e1c23f961 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:14.572934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-315924e8-11fd-438e-8aba-480e1c23f961 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:14.573375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-315924e8-11fd-438e-8aba-480e1c23f961 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:14.635405 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-315924e8-11fd-438e-8aba-480e1c23f961 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:14.644022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-315924e8-11fd-438e-8aba-480e1c23f961 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083102 Jun 02 16:38:14.644586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1193/2146] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:14 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:14.919046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-215ce221-f6d5-417b-9b03-1fdc2545b497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:14.919612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-215ce221-f6d5-417b-9b03-1fdc2545b497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:14.925710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-215ce221-f6d5-417b-9b03-1fdc2545b497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:14.926185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-215ce221-f6d5-417b-9b03-1fdc2545b497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:14.926939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-215ce221-f6d5-417b-9b03-1fdc2545b497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:14.927368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-215ce221-f6d5-417b-9b03-1fdc2545b497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:14.988704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-215ce221-f6d5-417b-9b03-1fdc2545b497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:14.998673 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-215ce221-f6d5-417b-9b03-1fdc2545b497 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083595 Jun 02 16:38:14.999241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 954/2147] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:15.661810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b5ab56d5-ac8a-4bba-9734-b2bc376560dc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:15.662398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b5ab56d5-ac8a-4bba-9734-b2bc376560dc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:15.669468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b5ab56d5-ac8a-4bba-9734-b2bc376560dc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:15.669917 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b5ab56d5-ac8a-4bba-9734-b2bc376560dc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:15.670704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b5ab56d5-ac8a-4bba-9734-b2bc376560dc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:15.671145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b5ab56d5-ac8a-4bba-9734-b2bc376560dc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:15.732738 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b5ab56d5-ac8a-4bba-9734-b2bc376560dc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:15.740703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b5ab56d5-ac8a-4bba-9734-b2bc376560dc tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082896 Jun 02 16:38:15.741276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1194/2148] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:15 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:16.015915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9a3b2411-335a-4e68-9b6b-52da432027c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:16.016556 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9a3b2411-335a-4e68-9b6b-52da432027c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:16.023059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9a3b2411-335a-4e68-9b6b-52da432027c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:16.023508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9a3b2411-335a-4e68-9b6b-52da432027c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:16.024272 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9a3b2411-335a-4e68-9b6b-52da432027c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:16.024710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9a3b2411-335a-4e68-9b6b-52da432027c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:16.089496 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9a3b2411-335a-4e68-9b6b-52da432027c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:16.098492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9a3b2411-335a-4e68-9b6b-52da432027c2 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087153 Jun 02 16:38:16.099063 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 955/2149] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:16.757741 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ce2c8429-1817-4ea5-8707-3f1e8117177e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:16.758394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ce2c8429-1817-4ea5-8707-3f1e8117177e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:16.765324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce2c8429-1817-4ea5-8707-3f1e8117177e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:16.765762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce2c8429-1817-4ea5-8707-3f1e8117177e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:16.766568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce2c8429-1817-4ea5-8707-3f1e8117177e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:16.767004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce2c8429-1817-4ea5-8707-3f1e8117177e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:16.829991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ce2c8429-1817-4ea5-8707-3f1e8117177e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:16.838184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ce2c8429-1817-4ea5-8707-3f1e8117177e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084259 Jun 02 16:38:16.838752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1195/2150] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:16 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:17.115008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e6bf4f31-630a-43ef-8585-c0e36657525e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:17.115621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e6bf4f31-630a-43ef-8585-c0e36657525e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:17.117942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=56 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:17.123424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f31-630a-43ef-8585-c0e36657525e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:17.123876 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f31-630a-43ef-8585-c0e36657525e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:17.124641 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f31-630a-43ef-8585-c0e36657525e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:17.125083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f31-630a-43ef-8585-c0e36657525e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:17.140648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:17.191152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e6bf4f31-630a-43ef-8585-c0e36657525e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:17.199615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e6bf4f31-630a-43ef-8585-c0e36657525e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087870 Jun 02 16:38:17.200190 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 956/2151] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:17.856519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-edc52716-4239-49a3-85fa-0451918ac381 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:17.857084 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-edc52716-4239-49a3-85fa-0451918ac381 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:17.863621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-edc52716-4239-49a3-85fa-0451918ac381 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:17.864068 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-edc52716-4239-49a3-85fa-0451918ac381 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:17.864838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-edc52716-4239-49a3-85fa-0451918ac381 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:17.865274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-edc52716-4239-49a3-85fa-0451918ac381 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:17.937564 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-edc52716-4239-49a3-85fa-0451918ac381 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:17.946269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-edc52716-4239-49a3-85fa-0451918ac381 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.094375 Jun 02 16:38:17.946862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1196/2152] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:17 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:18.217660 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ccaef817-38d8-4609-aa64-e2e92cec0dcc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:18.218310 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ccaef817-38d8-4609-aa64-e2e92cec0dcc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:18.224786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ccaef817-38d8-4609-aa64-e2e92cec0dcc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:18.225253 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ccaef817-38d8-4609-aa64-e2e92cec0dcc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:18.226011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ccaef817-38d8-4609-aa64-e2e92cec0dcc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:18.226478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ccaef817-38d8-4609-aa64-e2e92cec0dcc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:18.287970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ccaef817-38d8-4609-aa64-e2e92cec0dcc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:18.295902 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ccaef817-38d8-4609-aa64-e2e92cec0dcc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083298 Jun 02 16:38:18.296451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 957/2153] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:18.965097 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a15855dc-7966-422d-90c4-86321b1fc505 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:18.965734 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a15855dc-7966-422d-90c4-86321b1fc505 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:18.968050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=56 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:18.972828 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a15855dc-7966-422d-90c4-86321b1fc505 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:18.973302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a15855dc-7966-422d-90c4-86321b1fc505 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:18.974055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a15855dc-7966-422d-90c4-86321b1fc505 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:18.974513 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a15855dc-7966-422d-90c4-86321b1fc505 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:19.037102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a15855dc-7966-422d-90c4-86321b1fc505 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:19.045024 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a15855dc-7966-422d-90c4-86321b1fc505 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084645 Jun 02 16:38:19.045587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1197/2154] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:18 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:19.313713 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d2dbc002-f5b5-45e3-b231-948e848b4908 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:19.314438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d2dbc002-f5b5-45e3-b231-948e848b4908 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:19.320939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2dbc002-f5b5-45e3-b231-948e848b4908 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:19.321393 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2dbc002-f5b5-45e3-b231-948e848b4908 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:19.322187 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2dbc002-f5b5-45e3-b231-948e848b4908 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:19.322635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2dbc002-f5b5-45e3-b231-948e848b4908 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:19.383802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d2dbc002-f5b5-45e3-b231-948e848b4908 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:19.392814 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d2dbc002-f5b5-45e3-b231-948e848b4908 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083030 Jun 02 16:38:19.393378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 958/2155] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:19 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:20.061982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-32d499c2-dce4-43fd-be80-0cdd2f50919e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:20.062615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-32d499c2-dce4-43fd-be80-0cdd2f50919e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:20.068985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32d499c2-dce4-43fd-be80-0cdd2f50919e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:20.069427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32d499c2-dce4-43fd-be80-0cdd2f50919e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:20.070215 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32d499c2-dce4-43fd-be80-0cdd2f50919e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:20.070645 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-32d499c2-dce4-43fd-be80-0cdd2f50919e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:20.131778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-32d499c2-dce4-43fd-be80-0cdd2f50919e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:20.139880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-32d499c2-dce4-43fd-be80-0cdd2f50919e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081827 Jun 02 16:38:20.140445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1198/2156] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:20 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:20.410570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8f21bed6-f122-4117-9db1-7aeab2caa18b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:20.411118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8f21bed6-f122-4117-9db1-7aeab2caa18b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:20.418418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8f21bed6-f122-4117-9db1-7aeab2caa18b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:20.419030 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8f21bed6-f122-4117-9db1-7aeab2caa18b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:20.419815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8f21bed6-f122-4117-9db1-7aeab2caa18b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:20.420255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8f21bed6-f122-4117-9db1-7aeab2caa18b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:20.483917 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8f21bed6-f122-4117-9db1-7aeab2caa18b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:20.491930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8f21bed6-f122-4117-9db1-7aeab2caa18b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086107 Jun 02 16:38:20.492503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 959/2157] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:21.157388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c1949069-0615-4213-9dc5-71287e4e011d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:21.157995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c1949069-0615-4213-9dc5-71287e4e011d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:21.164435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1949069-0615-4213-9dc5-71287e4e011d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:21.164880 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1949069-0615-4213-9dc5-71287e4e011d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:21.165628 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1949069-0615-4213-9dc5-71287e4e011d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:21.166059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c1949069-0615-4213-9dc5-71287e4e011d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:21.230517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c1949069-0615-4213-9dc5-71287e4e011d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:21.238457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c1949069-0615-4213-9dc5-71287e4e011d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084837 Jun 02 16:38:21.239017 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1199/2158] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:21 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:21.509986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-dcde9d91-5027-488d-9a5d-c05c9208316b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:21.510663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-dcde9d91-5027-488d-9a5d-c05c9208316b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:21.517103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dcde9d91-5027-488d-9a5d-c05c9208316b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:21.525163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dcde9d91-5027-488d-9a5d-c05c9208316b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:21.525163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dcde9d91-5027-488d-9a5d-c05c9208316b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:21.525163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dcde9d91-5027-488d-9a5d-c05c9208316b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:21.583708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-dcde9d91-5027-488d-9a5d-c05c9208316b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:21.592649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-dcde9d91-5027-488d-9a5d-c05c9208316b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086568 Jun 02 16:38:21.593239 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 960/2159] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:22.255209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2fd61c23-d239-4999-a945-84c2c7caf400 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:22.255815 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2fd61c23-d239-4999-a945-84c2c7caf400 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:22.262263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2fd61c23-d239-4999-a945-84c2c7caf400 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:22.262708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2fd61c23-d239-4999-a945-84c2c7caf400 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:22.263457 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2fd61c23-d239-4999-a945-84c2c7caf400 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:22.263891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2fd61c23-d239-4999-a945-84c2c7caf400 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:22.324704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2fd61c23-d239-4999-a945-84c2c7caf400 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:22.326927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:22.333231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2fd61c23-d239-4999-a945-84c2c7caf400 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081841 Jun 02 16:38:22.333795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1200/2160] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:22 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:22.609479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-376c582e-252e-4461-a4f5-492f7dadc45f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:22.610030 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-376c582e-252e-4461-a4f5-492f7dadc45f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:22.616519 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-376c582e-252e-4461-a4f5-492f7dadc45f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:22.616963 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-376c582e-252e-4461-a4f5-492f7dadc45f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:22.617715 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-376c582e-252e-4461-a4f5-492f7dadc45f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:22.618175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-376c582e-252e-4461-a4f5-492f7dadc45f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:22.679356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-376c582e-252e-4461-a4f5-492f7dadc45f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:22.687398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-376c582e-252e-4461-a4f5-492f7dadc45f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082588 Jun 02 16:38:22.687953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 961/2161] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:23.350862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cb6a9de3-a63b-45ce-941e-0cfa0fdb87d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:23.351472 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cb6a9de3-a63b-45ce-941e-0cfa0fdb87d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:23.358422 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb6a9de3-a63b-45ce-941e-0cfa0fdb87d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:23.358870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb6a9de3-a63b-45ce-941e-0cfa0fdb87d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:23.359620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb6a9de3-a63b-45ce-941e-0cfa0fdb87d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:23.360051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cb6a9de3-a63b-45ce-941e-0cfa0fdb87d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:23.420463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cb6a9de3-a63b-45ce-941e-0cfa0fdb87d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:23.428266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cb6a9de3-a63b-45ce-941e-0cfa0fdb87d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081175 Jun 02 16:38:23.428765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1201/2162] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:23 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:23.704487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-eee44483-e01d-44f0-8ae1-4e3f0304cffb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:23.705053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-eee44483-e01d-44f0-8ae1-4e3f0304cffb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:23.711779 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eee44483-e01d-44f0-8ae1-4e3f0304cffb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:23.712240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eee44483-e01d-44f0-8ae1-4e3f0304cffb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:23.712995 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eee44483-e01d-44f0-8ae1-4e3f0304cffb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:23.713424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eee44483-e01d-44f0-8ae1-4e3f0304cffb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:23.774291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eee44483-e01d-44f0-8ae1-4e3f0304cffb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:23.782787 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-eee44483-e01d-44f0-8ae1-4e3f0304cffb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082220 Jun 02 16:38:23.783347 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 962/2163] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:24.471345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5eea0176-4f6d-4a78-bfeb-8c1af5fb6686 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:24.471345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5eea0176-4f6d-4a78-bfeb-8c1af5fb6686 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:24.471345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5eea0176-4f6d-4a78-bfeb-8c1af5fb6686 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:24.471345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5eea0176-4f6d-4a78-bfeb-8c1af5fb6686 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:24.472385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5eea0176-4f6d-4a78-bfeb-8c1af5fb6686 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:24.472385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5eea0176-4f6d-4a78-bfeb-8c1af5fb6686 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:24.519805 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5eea0176-4f6d-4a78-bfeb-8c1af5fb6686 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:24.527991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5eea0176-4f6d-4a78-bfeb-8c1af5fb6686 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.086603 Jun 02 16:38:24.528563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1202/2164] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:24 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:24.799644 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8c8069fa-b960-4f1c-a737-9280210a1c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:24.800224 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8c8069fa-b960-4f1c-a737-9280210a1c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:24.806693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c8069fa-b960-4f1c-a737-9280210a1c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:24.807145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c8069fa-b960-4f1c-a737-9280210a1c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:24.808622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c8069fa-b960-4f1c-a737-9280210a1c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:24.808839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8c8069fa-b960-4f1c-a737-9280210a1c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:24.868503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8c8069fa-b960-4f1c-a737-9280210a1c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:24.876899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8c8069fa-b960-4f1c-a737-9280210a1c2e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081236 Jun 02 16:38:24.877472 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 963/2165] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:25.544649 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bce6c834-ad30-4a33-9394-99a9fdc6ca61 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:25.545250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bce6c834-ad30-4a33-9394-99a9fdc6ca61 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:25.551740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bce6c834-ad30-4a33-9394-99a9fdc6ca61 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:25.552182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bce6c834-ad30-4a33-9394-99a9fdc6ca61 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:25.552926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bce6c834-ad30-4a33-9394-99a9fdc6ca61 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:25.553354 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bce6c834-ad30-4a33-9394-99a9fdc6ca61 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:25.781698 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bce6c834-ad30-4a33-9394-99a9fdc6ca61 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:25.789713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bce6c834-ad30-4a33-9394-99a9fdc6ca61 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.248855 Jun 02 16:38:25.790294 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1203/2166] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:25 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:25.894764 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ce0ba98c-5ad7-4c1f-b2d8-0a539e059584 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:25.895311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ce0ba98c-5ad7-4c1f-b2d8-0a539e059584 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:25.902291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba98c-5ad7-4c1f-b2d8-0a539e059584 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:25.902571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba98c-5ad7-4c1f-b2d8-0a539e059584 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:25.903327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba98c-5ad7-4c1f-b2d8-0a539e059584 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:25.903756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ce0ba98c-5ad7-4c1f-b2d8-0a539e059584 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:25.967037 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ce0ba98c-5ad7-4c1f-b2d8-0a539e059584 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:25.974991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ce0ba98c-5ad7-4c1f-b2d8-0a539e059584 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084091 Jun 02 16:38:25.975554 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 964/2167] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:25 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:26.188679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:38:26.188855 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:38:26.806807 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ddf9aa74-c0bb-40e8-9f9e-8eaadcea377d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:26.807419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ddf9aa74-c0bb-40e8-9f9e-8eaadcea377d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:26.814600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddf9aa74-c0bb-40e8-9f9e-8eaadcea377d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:26.815047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddf9aa74-c0bb-40e8-9f9e-8eaadcea377d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:26.815796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddf9aa74-c0bb-40e8-9f9e-8eaadcea377d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:26.816229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddf9aa74-c0bb-40e8-9f9e-8eaadcea377d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:26.876742 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ddf9aa74-c0bb-40e8-9f9e-8eaadcea377d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:26.884630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ddf9aa74-c0bb-40e8-9f9e-8eaadcea377d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081635 Jun 02 16:38:26.885182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1204/2168] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:26 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:26.992488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fe61efd1-fc90-4d29-91d1-b3ee6ae8492f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:26.993107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fe61efd1-fc90-4d29-91d1-b3ee6ae8492f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:27.000730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe61efd1-fc90-4d29-91d1-b3ee6ae8492f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:27.001192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe61efd1-fc90-4d29-91d1-b3ee6ae8492f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:27.001996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe61efd1-fc90-4d29-91d1-b3ee6ae8492f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:27.002463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fe61efd1-fc90-4d29-91d1-b3ee6ae8492f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:27.063966 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fe61efd1-fc90-4d29-91d1-b3ee6ae8492f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:27.071836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fe61efd1-fc90-4d29-91d1-b3ee6ae8492f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083193 Jun 02 16:38:27.072510 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 965/2169] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:27.902433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d99c5f38-f97c-4247-9187-13cc93558abe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:27.902953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d99c5f38-f97c-4247-9187-13cc93558abe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:27.909451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d99c5f38-f97c-4247-9187-13cc93558abe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:27.909903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d99c5f38-f97c-4247-9187-13cc93558abe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:27.910718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d99c5f38-f97c-4247-9187-13cc93558abe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:27.911164 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d99c5f38-f97c-4247-9187-13cc93558abe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:27.972268 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d99c5f38-f97c-4247-9187-13cc93558abe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:27.980652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d99c5f38-f97c-4247-9187-13cc93558abe tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082528 Jun 02 16:38:27.981202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1205/2170] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:27 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:28.089776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-915cd946-1178-47ee-804f-55252e6ace12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:28.090403 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-915cd946-1178-47ee-804f-55252e6ace12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:28.096836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-915cd946-1178-47ee-804f-55252e6ace12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:28.097283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-915cd946-1178-47ee-804f-55252e6ace12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:28.098038 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-915cd946-1178-47ee-804f-55252e6ace12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:28.098492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-915cd946-1178-47ee-804f-55252e6ace12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:28.161314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-915cd946-1178-47ee-804f-55252e6ace12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:28.169816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-915cd946-1178-47ee-804f-55252e6ace12 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084198 Jun 02 16:38:28.170407 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 966/2171] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:28.998273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d10b7453-cbac-4b93-9343-955fdf6ad2fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:28.998874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d10b7453-cbac-4b93-9343-955fdf6ad2fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:29.005189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d10b7453-cbac-4b93-9343-955fdf6ad2fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:29.005630 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d10b7453-cbac-4b93-9343-955fdf6ad2fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:29.006400 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d10b7453-cbac-4b93-9343-955fdf6ad2fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:29.006829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d10b7453-cbac-4b93-9343-955fdf6ad2fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:29.067620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d10b7453-cbac-4b93-9343-955fdf6ad2fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:29.075836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d10b7453-cbac-4b93-9343-955fdf6ad2fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081988 Jun 02 16:38:29.076398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1206/2172] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:28 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:29.187078 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-10d10852-7e98-4259-81ec-9c6fa4d38669 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:29.187695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-10d10852-7e98-4259-81ec-9c6fa4d38669 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:29.194219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10d10852-7e98-4259-81ec-9c6fa4d38669 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:29.194671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10d10852-7e98-4259-81ec-9c6fa4d38669 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:29.195435 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10d10852-7e98-4259-81ec-9c6fa4d38669 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:29.195871 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-10d10852-7e98-4259-81ec-9c6fa4d38669 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:29.257727 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-10d10852-7e98-4259-81ec-9c6fa4d38669 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:29.265904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-10d10852-7e98-4259-81ec-9c6fa4d38669 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082941 Jun 02 16:38:29.266504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 967/2173] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:30.093555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-80263059-7f2c-4db0-aefd-b88089fb7b88 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:30.094203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-80263059-7f2c-4db0-aefd-b88089fb7b88 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:30.100643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80263059-7f2c-4db0-aefd-b88089fb7b88 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:30.101098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80263059-7f2c-4db0-aefd-b88089fb7b88 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:30.101860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80263059-7f2c-4db0-aefd-b88089fb7b88 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:30.102332 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-80263059-7f2c-4db0-aefd-b88089fb7b88 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:30.166220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-80263059-7f2c-4db0-aefd-b88089fb7b88 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:30.174533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-80263059-7f2c-4db0-aefd-b88089fb7b88 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.085360 Jun 02 16:38:30.175095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1207/2174] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:30 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:30.283623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5bb6233c-5978-4688-b454-49aff4e25246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:30.284228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5bb6233c-5978-4688-b454-49aff4e25246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:30.290998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5bb6233c-5978-4688-b454-49aff4e25246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:30.291460 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5bb6233c-5978-4688-b454-49aff4e25246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:30.292881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5bb6233c-5978-4688-b454-49aff4e25246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:30.293330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5bb6233c-5978-4688-b454-49aff4e25246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:30.358645 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5bb6233c-5978-4688-b454-49aff4e25246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:30.366551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5bb6233c-5978-4688-b454-49aff4e25246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086808 Jun 02 16:38:30.367116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 968/2175] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:31.191474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a73d46e2-b7a7-41ee-8577-039c4f598fde tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:31.192085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a73d46e2-b7a7-41ee-8577-039c4f598fde tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:31.198688 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a73d46e2-b7a7-41ee-8577-039c4f598fde tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:31.199122 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a73d46e2-b7a7-41ee-8577-039c4f598fde tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:31.199873 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a73d46e2-b7a7-41ee-8577-039c4f598fde tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:31.200305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a73d46e2-b7a7-41ee-8577-039c4f598fde tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:31.262252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a73d46e2-b7a7-41ee-8577-039c4f598fde tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:31.270154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a73d46e2-b7a7-41ee-8577-039c4f598fde tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082544 Jun 02 16:38:31.270720 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1208/2176] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:31 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:31.383374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c769be6c-bdce-4f02-8410-270bb7cfac78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:31.383928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c769be6c-bdce-4f02-8410-270bb7cfac78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:31.390775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c769be6c-bdce-4f02-8410-270bb7cfac78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:31.391233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c769be6c-bdce-4f02-8410-270bb7cfac78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:31.392002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c769be6c-bdce-4f02-8410-270bb7cfac78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:31.392441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c769be6c-bdce-4f02-8410-270bb7cfac78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:31.453105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c769be6c-bdce-4f02-8410-270bb7cfac78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:31.461060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c769be6c-bdce-4f02-8410-270bb7cfac78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081574 Jun 02 16:38:31.461879 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 969/2177] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:31 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:32.288580 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cbf0ecfb-aea6-4af0-ac03-9cd045778be6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:32.289257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cbf0ecfb-aea6-4af0-ac03-9cd045778be6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:32.297584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cbf0ecfb-aea6-4af0-ac03-9cd045778be6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:32.298037 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cbf0ecfb-aea6-4af0-ac03-9cd045778be6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:32.298826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cbf0ecfb-aea6-4af0-ac03-9cd045778be6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:32.299266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cbf0ecfb-aea6-4af0-ac03-9cd045778be6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:32.361344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cbf0ecfb-aea6-4af0-ac03-9cd045778be6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:32.369232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cbf0ecfb-aea6-4af0-ac03-9cd045778be6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084654 Jun 02 16:38:32.369788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1209/2178] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:32 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:32.478915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-528d58dc-6f36-4d02-bf9d-8d31759b587e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:32.479512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-528d58dc-6f36-4d02-bf9d-8d31759b587e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:32.485998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-528d58dc-6f36-4d02-bf9d-8d31759b587e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:32.486479 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-528d58dc-6f36-4d02-bf9d-8d31759b587e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:32.487240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-528d58dc-6f36-4d02-bf9d-8d31759b587e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:32.487673 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-528d58dc-6f36-4d02-bf9d-8d31759b587e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:32.548204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-528d58dc-6f36-4d02-bf9d-8d31759b587e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:32.555947 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-528d58dc-6f36-4d02-bf9d-8d31759b587e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.080861 Jun 02 16:38:32.556508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 970/2179] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:33.386344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8ffffab5-15e2-40ef-97f2-abac6a41b6a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:33.386894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8ffffab5-15e2-40ef-97f2-abac6a41b6a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:33.393205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ffffab5-15e2-40ef-97f2-abac6a41b6a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:33.393646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ffffab5-15e2-40ef-97f2-abac6a41b6a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:33.394476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ffffab5-15e2-40ef-97f2-abac6a41b6a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:33.394909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ffffab5-15e2-40ef-97f2-abac6a41b6a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:33.455638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8ffffab5-15e2-40ef-97f2-abac6a41b6a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:33.463681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8ffffab5-15e2-40ef-97f2-abac6a41b6a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081441 Jun 02 16:38:33.464238 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1210/2180] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:33 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:33.572815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8509f955-f2a8-43a9-b050-4aed3ae29256 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:33.573816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8509f955-f2a8-43a9-b050-4aed3ae29256 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:33.580336 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8509f955-f2a8-43a9-b050-4aed3ae29256 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:33.580788 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8509f955-f2a8-43a9-b050-4aed3ae29256 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:33.581554 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8509f955-f2a8-43a9-b050-4aed3ae29256 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:33.581992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8509f955-f2a8-43a9-b050-4aed3ae29256 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:33.643905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8509f955-f2a8-43a9-b050-4aed3ae29256 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:33.652611 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8509f955-f2a8-43a9-b050-4aed3ae29256 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083636 Jun 02 16:38:33.653173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 971/2181] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:34.480345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5b52b669-6f49-4d7f-9657-a59b158d681d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:34.480884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5b52b669-6f49-4d7f-9657-a59b158d681d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:34.487336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b52b669-6f49-4d7f-9657-a59b158d681d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:34.487780 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b52b669-6f49-4d7f-9657-a59b158d681d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:34.488528 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b52b669-6f49-4d7f-9657-a59b158d681d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:34.488958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5b52b669-6f49-4d7f-9657-a59b158d681d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:34.553712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5b52b669-6f49-4d7f-9657-a59b158d681d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:34.562291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5b52b669-6f49-4d7f-9657-a59b158d681d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.086129 Jun 02 16:38:34.562853 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1211/2182] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:34 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:34.669272 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-58b9a104-5dcd-4763-babf-1dd147f0829d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:34.669872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-58b9a104-5dcd-4763-babf-1dd147f0829d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:34.676282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58b9a104-5dcd-4763-babf-1dd147f0829d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:34.676726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58b9a104-5dcd-4763-babf-1dd147f0829d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:34.677480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58b9a104-5dcd-4763-babf-1dd147f0829d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:34.677911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-58b9a104-5dcd-4763-babf-1dd147f0829d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:34.743743 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-58b9a104-5dcd-4763-babf-1dd147f0829d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:34.752361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-58b9a104-5dcd-4763-babf-1dd147f0829d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087631 Jun 02 16:38:34.752922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 972/2183] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:35.579179 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0ebfff2c-8ed4-4646-a866-119f97b37241 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:35.580192 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0ebfff2c-8ed4-4646-a866-119f97b37241 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:35.586798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ebfff2c-8ed4-4646-a866-119f97b37241 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:35.587249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ebfff2c-8ed4-4646-a866-119f97b37241 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:35.588011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ebfff2c-8ed4-4646-a866-119f97b37241 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:35.588452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0ebfff2c-8ed4-4646-a866-119f97b37241 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:35.649011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0ebfff2c-8ed4-4646-a866-119f97b37241 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:35.657347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0ebfff2c-8ed4-4646-a866-119f97b37241 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082009 Jun 02 16:38:35.657909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1212/2184] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:35 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:38:35.768724 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b37657ec-e6a6-4bbc-95e4-3ac222887041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:35.769339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b37657ec-e6a6-4bbc-95e4-3ac222887041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:35.776120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b37657ec-e6a6-4bbc-95e4-3ac222887041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:35.776573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b37657ec-e6a6-4bbc-95e4-3ac222887041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:35.777858 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b37657ec-e6a6-4bbc-95e4-3ac222887041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:35.778439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b37657ec-e6a6-4bbc-95e4-3ac222887041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:35.782513 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:35.840593 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b37657ec-e6a6-4bbc-95e4-3ac222887041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:35.848380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b37657ec-e6a6-4bbc-95e4-3ac222887041 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083579 Jun 02 16:38:35.848936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 973/2185] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:35 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:36.674891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-304f0066-9ad1-47db-a274-367fbfc6088a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:36.675518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-304f0066-9ad1-47db-a274-367fbfc6088a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:36.681937 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-304f0066-9ad1-47db-a274-367fbfc6088a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:36.682410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-304f0066-9ad1-47db-a274-367fbfc6088a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:36.683158 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-304f0066-9ad1-47db-a274-367fbfc6088a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:36.684118 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-304f0066-9ad1-47db-a274-367fbfc6088a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:36.744764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-304f0066-9ad1-47db-a274-367fbfc6088a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:36.753230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-304f0066-9ad1-47db-a274-367fbfc6088a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082189 Jun 02 16:38:36.753804 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1213/2186] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:36 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:36.865900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0b457307-ed47-4bd2-b828-3b41169d59e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:36.866573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0b457307-ed47-4bd2-b828-3b41169d59e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:36.874118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b457307-ed47-4bd2-b828-3b41169d59e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:36.874576 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b457307-ed47-4bd2-b828-3b41169d59e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:36.875344 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b457307-ed47-4bd2-b828-3b41169d59e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:36.875821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0b457307-ed47-4bd2-b828-3b41169d59e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:36.936569 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0b457307-ed47-4bd2-b828-3b41169d59e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:36.944376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0b457307-ed47-4bd2-b828-3b41169d59e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082352 Jun 02 16:38:36.944941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 974/2187] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:36 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:37.770943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b6ee2723-6a2d-467b-b203-0bf1b31f9014 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:37.771561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b6ee2723-6a2d-467b-b203-0bf1b31f9014 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:37.778866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b6ee2723-6a2d-467b-b203-0bf1b31f9014 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:37.779343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b6ee2723-6a2d-467b-b203-0bf1b31f9014 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:37.780121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b6ee2723-6a2d-467b-b203-0bf1b31f9014 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:37.780631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b6ee2723-6a2d-467b-b203-0bf1b31f9014 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:37.842398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b6ee2723-6a2d-467b-b203-0bf1b31f9014 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:37.850398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b6ee2723-6a2d-467b-b203-0bf1b31f9014 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083411 Jun 02 16:38:37.850955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1214/2188] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:37 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:37.960578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-84de9ba6-b96b-40f5-9654-5ede1505f9fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:37.961127 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-84de9ba6-b96b-40f5-9654-5ede1505f9fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:37.968845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84de9ba6-b96b-40f5-9654-5ede1505f9fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:37.969295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84de9ba6-b96b-40f5-9654-5ede1505f9fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:37.970061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84de9ba6-b96b-40f5-9654-5ede1505f9fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:37.970542 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-84de9ba6-b96b-40f5-9654-5ede1505f9fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:38.031382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-84de9ba6-b96b-40f5-9654-5ede1505f9fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:38.039420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-84de9ba6-b96b-40f5-9654-5ede1505f9fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082708 Jun 02 16:38:38.039973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 975/2189] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:37 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:38.867980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-89e316c9-daf2-4aab-a4e5-8205276a65d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:38.868600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-89e316c9-daf2-4aab-a4e5-8205276a65d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:38.875144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89e316c9-daf2-4aab-a4e5-8205276a65d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:38.875600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89e316c9-daf2-4aab-a4e5-8205276a65d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:38.876365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89e316c9-daf2-4aab-a4e5-8205276a65d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:38.876807 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89e316c9-daf2-4aab-a4e5-8205276a65d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:38.942166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-89e316c9-daf2-4aab-a4e5-8205276a65d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:38.950137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-89e316c9-daf2-4aab-a4e5-8205276a65d1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.086063 Jun 02 16:38:38.950700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1215/2190] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:38 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:39.055837 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-50cc3832-27d7-4519-b015-960458113f85 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:39.056478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-50cc3832-27d7-4519-b015-960458113f85 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:39.063033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50cc3832-27d7-4519-b015-960458113f85 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:39.063483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50cc3832-27d7-4519-b015-960458113f85 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:39.064243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50cc3832-27d7-4519-b015-960458113f85 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:39.064679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-50cc3832-27d7-4519-b015-960458113f85 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:39.129628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-50cc3832-27d7-4519-b015-960458113f85 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:39.138360 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-50cc3832-27d7-4519-b015-960458113f85 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086321 Jun 02 16:38:39.138920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 976/2191] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:39.967419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e0e826af-0743-4a37-81f7-ba6bd3be480f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:39.968026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e0e826af-0743-4a37-81f7-ba6bd3be480f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:39.974448 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0e826af-0743-4a37-81f7-ba6bd3be480f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:39.974893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0e826af-0743-4a37-81f7-ba6bd3be480f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:39.975642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0e826af-0743-4a37-81f7-ba6bd3be480f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:39.976072 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e0e826af-0743-4a37-81f7-ba6bd3be480f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:40.036071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e0e826af-0743-4a37-81f7-ba6bd3be480f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:40.044382 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e0e826af-0743-4a37-81f7-ba6bd3be480f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.080880 Jun 02 16:38:40.044934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1216/2192] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:39 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:40.155106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-631fcc63-b489-4c64-986a-4de7595e62a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:40.155719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-631fcc63-b489-4c64-986a-4de7595e62a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:40.162247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-631fcc63-b489-4c64-986a-4de7595e62a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:40.162700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-631fcc63-b489-4c64-986a-4de7595e62a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:40.163464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-631fcc63-b489-4c64-986a-4de7595e62a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:40.163896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-631fcc63-b489-4c64-986a-4de7595e62a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:40.227687 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-631fcc63-b489-4c64-986a-4de7595e62a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:40.236253 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-631fcc63-b489-4c64-986a-4de7595e62a9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084931 Jun 02 16:38:40.240386 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 977/2193] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:41.061570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-16b9739c-c248-4372-90a5-bd4dfbb8efe0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:41.062199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-16b9739c-c248-4372-90a5-bd4dfbb8efe0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:41.068667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16b9739c-c248-4372-90a5-bd4dfbb8efe0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:41.069112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16b9739c-c248-4372-90a5-bd4dfbb8efe0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:41.069860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16b9739c-c248-4372-90a5-bd4dfbb8efe0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:41.070320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-16b9739c-c248-4372-90a5-bd4dfbb8efe0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:41.085401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:41.132404 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-16b9739c-c248-4372-90a5-bd4dfbb8efe0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:41.141498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-16b9739c-c248-4372-90a5-bd4dfbb8efe0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084239 Jun 02 16:38:41.142084 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1217/2194] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:41 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:41.368366 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d2447671-7fbd-439e-a074-1f2eba8ba7c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:41.368983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d2447671-7fbd-439e-a074-1f2eba8ba7c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:41.375768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2447671-7fbd-439e-a074-1f2eba8ba7c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:41.376219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2447671-7fbd-439e-a074-1f2eba8ba7c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:41.376977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2447671-7fbd-439e-a074-1f2eba8ba7c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:41.377411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d2447671-7fbd-439e-a074-1f2eba8ba7c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:41.440624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d2447671-7fbd-439e-a074-1f2eba8ba7c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:41.448468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d2447671-7fbd-439e-a074-1f2eba8ba7c9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.196814 Jun 02 16:38:41.449059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 978/2195] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:42.158834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5dc1a556-2a6e-4ad8-973e-259be2bb6c27 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:42.159445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5dc1a556-2a6e-4ad8-973e-259be2bb6c27 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:42.165842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5dc1a556-2a6e-4ad8-973e-259be2bb6c27 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:42.166330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5dc1a556-2a6e-4ad8-973e-259be2bb6c27 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:42.167096 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5dc1a556-2a6e-4ad8-973e-259be2bb6c27 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:42.167535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5dc1a556-2a6e-4ad8-973e-259be2bb6c27 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:42.228230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5dc1a556-2a6e-4ad8-973e-259be2bb6c27 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:42.236335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5dc1a556-2a6e-4ad8-973e-259be2bb6c27 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081339 Jun 02 16:38:42.236898 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1218/2196] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:42 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:42.465721 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-94352cf5-8686-4a7d-b17d-b0ce051103e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:42.466374 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-94352cf5-8686-4a7d-b17d-b0ce051103e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:42.472863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-94352cf5-8686-4a7d-b17d-b0ce051103e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:42.473320 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-94352cf5-8686-4a7d-b17d-b0ce051103e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:42.474101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-94352cf5-8686-4a7d-b17d-b0ce051103e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:42.474547 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-94352cf5-8686-4a7d-b17d-b0ce051103e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:42.596575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-94352cf5-8686-4a7d-b17d-b0ce051103e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:42.604543 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-94352cf5-8686-4a7d-b17d-b0ce051103e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.143679 Jun 02 16:38:42.605669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 979/2197] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:43.253159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-27e2a8b3-5f59-4c68-a22f-b4f1819e17a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:43.253778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-27e2a8b3-5f59-4c68-a22f-b4f1819e17a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:43.260243 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-27e2a8b3-5f59-4c68-a22f-b4f1819e17a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:43.260695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-27e2a8b3-5f59-4c68-a22f-b4f1819e17a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:43.262250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-27e2a8b3-5f59-4c68-a22f-b4f1819e17a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:43.262700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-27e2a8b3-5f59-4c68-a22f-b4f1819e17a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:43.373945 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-27e2a8b3-5f59-4c68-a22f-b4f1819e17a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:43.381894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-27e2a8b3-5f59-4c68-a22f-b4f1819e17a7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.132565 Jun 02 16:38:43.382488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1219/2198] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:43 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:43.623105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0e7ad2d4-a306-4f9a-aa02-4eac6066036a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:43.623680 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0e7ad2d4-a306-4f9a-aa02-4eac6066036a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:43.630341 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e7ad2d4-a306-4f9a-aa02-4eac6066036a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:43.630799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e7ad2d4-a306-4f9a-aa02-4eac6066036a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:43.631573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e7ad2d4-a306-4f9a-aa02-4eac6066036a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:43.632011 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e7ad2d4-a306-4f9a-aa02-4eac6066036a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:43.696332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0e7ad2d4-a306-4f9a-aa02-4eac6066036a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:43.704425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0e7ad2d4-a306-4f9a-aa02-4eac6066036a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086393 Jun 02 16:38:43.704988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 980/2199] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:43 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:44.399139 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ce444069-a757-4c12-ac6b-4720eabd301e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:44.399755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ce444069-a757-4c12-ac6b-4720eabd301e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:44.406487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce444069-a757-4c12-ac6b-4720eabd301e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:44.406943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce444069-a757-4c12-ac6b-4720eabd301e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:44.407702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce444069-a757-4c12-ac6b-4720eabd301e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:44.408142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce444069-a757-4c12-ac6b-4720eabd301e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:44.468865 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ce444069-a757-4c12-ac6b-4720eabd301e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:44.476818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ce444069-a757-4c12-ac6b-4720eabd301e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081790 Jun 02 16:38:44.477381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1220/2200] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:44 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:44.721880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fa6cd01d-a4e1-48d7-8609-3032d9097949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:44.722548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fa6cd01d-a4e1-48d7-8609-3032d9097949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:44.728878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa6cd01d-a4e1-48d7-8609-3032d9097949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:44.729329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa6cd01d-a4e1-48d7-8609-3032d9097949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:44.730206 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa6cd01d-a4e1-48d7-8609-3032d9097949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:44.730647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa6cd01d-a4e1-48d7-8609-3032d9097949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:44.791425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fa6cd01d-a4e1-48d7-8609-3032d9097949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:44.799638 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fa6cd01d-a4e1-48d7-8609-3032d9097949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081645 Jun 02 16:38:44.800208 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 981/2201] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:44 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:45.493884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f91c2910-e2ad-4640-820b-dc3ac0083d08 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:45.494533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f91c2910-e2ad-4640-820b-dc3ac0083d08 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:45.500987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f91c2910-e2ad-4640-820b-dc3ac0083d08 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:45.501436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f91c2910-e2ad-4640-820b-dc3ac0083d08 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:45.502229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f91c2910-e2ad-4640-820b-dc3ac0083d08 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:45.502668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f91c2910-e2ad-4640-820b-dc3ac0083d08 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:45.563471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f91c2910-e2ad-4640-820b-dc3ac0083d08 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:45.571632 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f91c2910-e2ad-4640-820b-dc3ac0083d08 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081560 Jun 02 16:38:45.572188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1221/2202] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:45 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:45.816676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-14a86518-e3f1-4a56-a7c4-6d45bd7614e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:45.817362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-14a86518-e3f1-4a56-a7c4-6d45bd7614e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:45.823445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14a86518-e3f1-4a56-a7c4-6d45bd7614e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:45.824020 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14a86518-e3f1-4a56-a7c4-6d45bd7614e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:45.825124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14a86518-e3f1-4a56-a7c4-6d45bd7614e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:45.825573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-14a86518-e3f1-4a56-a7c4-6d45bd7614e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:45.894843 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-14a86518-e3f1-4a56-a7c4-6d45bd7614e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:45.903772 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-14a86518-e3f1-4a56-a7c4-6d45bd7614e4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.090806 Jun 02 16:38:45.904348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 982/2203] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:46.588036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9263357d-7268-41a6-9608-5ca08e76808e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:46.588636 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9263357d-7268-41a6-9608-5ca08e76808e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:46.595226 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9263357d-7268-41a6-9608-5ca08e76808e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:46.595671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9263357d-7268-41a6-9608-5ca08e76808e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:46.596417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9263357d-7268-41a6-9608-5ca08e76808e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:46.596845 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9263357d-7268-41a6-9608-5ca08e76808e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:46.659918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9263357d-7268-41a6-9608-5ca08e76808e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:46.668337 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9263357d-7268-41a6-9608-5ca08e76808e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084371 Jun 02 16:38:46.668890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1222/2204] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:46 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:46.921640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c62ad7f3-abec-42f1-9fc3-7405aedabc2c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:46.922292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c62ad7f3-abec-42f1-9fc3-7405aedabc2c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:46.928807 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c62ad7f3-abec-42f1-9fc3-7405aedabc2c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:46.929267 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c62ad7f3-abec-42f1-9fc3-7405aedabc2c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:46.930035 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c62ad7f3-abec-42f1-9fc3-7405aedabc2c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:46.930738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c62ad7f3-abec-42f1-9fc3-7405aedabc2c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:46.993105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c62ad7f3-abec-42f1-9fc3-7405aedabc2c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:47.001329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c62ad7f3-abec-42f1-9fc3-7405aedabc2c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084462 Jun 02 16:38:47.001900 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 983/2205] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:47.686454 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a5876b36-4046-4112-bc3c-d078c70505ed tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:47.689197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a5876b36-4046-4112-bc3c-d078c70505ed tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:47.693631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5876b36-4046-4112-bc3c-d078c70505ed tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:47.694095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5876b36-4046-4112-bc3c-d078c70505ed tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:47.694874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5876b36-4046-4112-bc3c-d078c70505ed tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:47.695371 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5876b36-4046-4112-bc3c-d078c70505ed tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:47.758923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a5876b36-4046-4112-bc3c-d078c70505ed tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:47.766884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a5876b36-4046-4112-bc3c-d078c70505ed tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084998 Jun 02 16:38:47.767453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1223/2206] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:47 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:48.017935 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e60615fa-bdcf-475a-844f-85b0426cbb8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:48.018607 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e60615fa-bdcf-475a-844f-85b0426cbb8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:48.020954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=56 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:48.025795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e60615fa-bdcf-475a-844f-85b0426cbb8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:48.029438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e60615fa-bdcf-475a-844f-85b0426cbb8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:48.029438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e60615fa-bdcf-475a-844f-85b0426cbb8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:48.029438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e60615fa-bdcf-475a-844f-85b0426cbb8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:48.096001 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e60615fa-bdcf-475a-844f-85b0426cbb8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:48.103916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e60615fa-bdcf-475a-844f-85b0426cbb8a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.089876 Jun 02 16:38:48.104485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 984/2207] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:48 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:48.783651 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9c3d0435-9d11-4ac1-929c-e2552c872c51 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:48.784244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9c3d0435-9d11-4ac1-929c-e2552c872c51 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:48.790762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c3d0435-9d11-4ac1-929c-e2552c872c51 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:48.791218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c3d0435-9d11-4ac1-929c-e2552c872c51 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:48.791979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c3d0435-9d11-4ac1-929c-e2552c872c51 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:48.792520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c3d0435-9d11-4ac1-929c-e2552c872c51 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:48.854500 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9c3d0435-9d11-4ac1-929c-e2552c872c51 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:48.863142 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9c3d0435-9d11-4ac1-929c-e2552c872c51 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083306 Jun 02 16:38:48.863712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1224/2208] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:48 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:49.121273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9d7ac9fa-af8d-42bb-af4f-7ec84308b6ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:49.121882 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9d7ac9fa-af8d-42bb-af4f-7ec84308b6ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:49.128321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d7ac9fa-af8d-42bb-af4f-7ec84308b6ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:49.128765 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d7ac9fa-af8d-42bb-af4f-7ec84308b6ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:49.129516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d7ac9fa-af8d-42bb-af4f-7ec84308b6ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:49.129948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9d7ac9fa-af8d-42bb-af4f-7ec84308b6ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:49.194195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9d7ac9fa-af8d-42bb-af4f-7ec84308b6ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:49.202280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9d7ac9fa-af8d-42bb-af4f-7ec84308b6ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085429 Jun 02 16:38:49.202839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 985/2209] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:49.880357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-14fcdf32-93fb-4bef-bf0d-062a21954be7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:49.880978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-14fcdf32-93fb-4bef-bf0d-062a21954be7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:49.883339 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=56 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:49.888643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14fcdf32-93fb-4bef-bf0d-062a21954be7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:49.891712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14fcdf32-93fb-4bef-bf0d-062a21954be7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:49.891712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14fcdf32-93fb-4bef-bf0d-062a21954be7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:49.891712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-14fcdf32-93fb-4bef-bf0d-062a21954be7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:49.957842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-14fcdf32-93fb-4bef-bf0d-062a21954be7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:49.968733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-14fcdf32-93fb-4bef-bf0d-062a21954be7 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.092454 Jun 02 16:38:49.969302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1225/2210] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:49 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:50.219612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a66e962f-08d9-49b9-bfab-c65f8760c504 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:50.220226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a66e962f-08d9-49b9-bfab-c65f8760c504 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:50.229189 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a66e962f-08d9-49b9-bfab-c65f8760c504 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:50.230278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a66e962f-08d9-49b9-bfab-c65f8760c504 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:50.231354 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a66e962f-08d9-49b9-bfab-c65f8760c504 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:50.232020 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a66e962f-08d9-49b9-bfab-c65f8760c504 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:50.295863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a66e962f-08d9-49b9-bfab-c65f8760c504 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:50.303737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a66e962f-08d9-49b9-bfab-c65f8760c504 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.088056 Jun 02 16:38:50.305203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 986/2211] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:50.985043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cea3d77e-9dde-42c1-8624-1497a5e2eb56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:50.985686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cea3d77e-9dde-42c1-8624-1497a5e2eb56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:50.992178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cea3d77e-9dde-42c1-8624-1497a5e2eb56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:50.992626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cea3d77e-9dde-42c1-8624-1497a5e2eb56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:50.993381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cea3d77e-9dde-42c1-8624-1497a5e2eb56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:50.993824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cea3d77e-9dde-42c1-8624-1497a5e2eb56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:51.055364 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cea3d77e-9dde-42c1-8624-1497a5e2eb56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:51.063902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cea3d77e-9dde-42c1-8624-1497a5e2eb56 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082726 Jun 02 16:38:51.064464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1226/2212] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:50 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:51.320746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-86446168-d2ec-4c98-a8a3-da39c2a02436 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:51.321313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-86446168-d2ec-4c98-a8a3-da39c2a02436 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:51.328307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-86446168-d2ec-4c98-a8a3-da39c2a02436 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:51.328765 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-86446168-d2ec-4c98-a8a3-da39c2a02436 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:51.329530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-86446168-d2ec-4c98-a8a3-da39c2a02436 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:51.329970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-86446168-d2ec-4c98-a8a3-da39c2a02436 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:51.392004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-86446168-d2ec-4c98-a8a3-da39c2a02436 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:51.399935 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-86446168-d2ec-4c98-a8a3-da39c2a02436 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083139 Jun 02 16:38:51.400502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 987/2213] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:52.080694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9b52a25f-a884-43a7-b049-4d7a71553def tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:52.081310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9b52a25f-a884-43a7-b049-4d7a71553def tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:52.087997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b52a25f-a884-43a7-b049-4d7a71553def tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:52.088438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b52a25f-a884-43a7-b049-4d7a71553def tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:52.089216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b52a25f-a884-43a7-b049-4d7a71553def tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:52.089640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9b52a25f-a884-43a7-b049-4d7a71553def tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:52.152404 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9b52a25f-a884-43a7-b049-4d7a71553def tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:52.160646 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9b52a25f-a884-43a7-b049-4d7a71553def tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083789 Jun 02 16:38:52.161208 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1227/2214] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:52 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:52.416133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-47bd282c-90b6-4187-9b80-4e81392c0ff1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:52.416698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-47bd282c-90b6-4187-9b80-4e81392c0ff1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:52.423702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-47bd282c-90b6-4187-9b80-4e81392c0ff1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:52.424147 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-47bd282c-90b6-4187-9b80-4e81392c0ff1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:52.424899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-47bd282c-90b6-4187-9b80-4e81392c0ff1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:52.425330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-47bd282c-90b6-4187-9b80-4e81392c0ff1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:52.489055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-47bd282c-90b6-4187-9b80-4e81392c0ff1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:52.497212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-47bd282c-90b6-4187-9b80-4e81392c0ff1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084986 Jun 02 16:38:52.497802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 988/2215] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:52 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:53.177650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-09c6929a-a6ed-492a-ad88-ccc4e7f8227d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:53.178304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-09c6929a-a6ed-492a-ad88-ccc4e7f8227d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:53.185570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09c6929a-a6ed-492a-ad88-ccc4e7f8227d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:53.186021 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09c6929a-a6ed-492a-ad88-ccc4e7f8227d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:53.186813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09c6929a-a6ed-492a-ad88-ccc4e7f8227d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:53.187254 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-09c6929a-a6ed-492a-ad88-ccc4e7f8227d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:53.249209 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-09c6929a-a6ed-492a-ad88-ccc4e7f8227d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:53.257175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-09c6929a-a6ed-492a-ad88-ccc4e7f8227d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083363 Jun 02 16:38:53.257736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1228/2216] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:53 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:53.514464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5e252cb6-a52b-4126-91c8-b4680b254eb0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:53.515074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5e252cb6-a52b-4126-91c8-b4680b254eb0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:53.521550 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5e252cb6-a52b-4126-91c8-b4680b254eb0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:53.522003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5e252cb6-a52b-4126-91c8-b4680b254eb0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:53.522824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5e252cb6-a52b-4126-91c8-b4680b254eb0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:53.523270 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5e252cb6-a52b-4126-91c8-b4680b254eb0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:53.584975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5e252cb6-a52b-4126-91c8-b4680b254eb0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:53.587499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:53.593953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5e252cb6-a52b-4126-91c8-b4680b254eb0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083717 Jun 02 16:38:53.594573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 989/2217] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:53 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:54.274728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ea4130aa-d775-4281-bf69-363c3edee352 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:54.275345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ea4130aa-d775-4281-bf69-363c3edee352 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:54.282565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea4130aa-d775-4281-bf69-363c3edee352 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:54.283017 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea4130aa-d775-4281-bf69-363c3edee352 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:54.283779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea4130aa-d775-4281-bf69-363c3edee352 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:54.284222 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ea4130aa-d775-4281-bf69-363c3edee352 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:54.347104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ea4130aa-d775-4281-bf69-363c3edee352 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:54.356048 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ea4130aa-d775-4281-bf69-363c3edee352 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084747 Jun 02 16:38:54.356616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1229/2218] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:54 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:54.611552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a63cbcb4-c702-4135-9a11-98b4469ad045 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:54.612163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a63cbcb4-c702-4135-9a11-98b4469ad045 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:54.619072 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a63cbcb4-c702-4135-9a11-98b4469ad045 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:54.619516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a63cbcb4-c702-4135-9a11-98b4469ad045 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:54.620964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a63cbcb4-c702-4135-9a11-98b4469ad045 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:54.621448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a63cbcb4-c702-4135-9a11-98b4469ad045 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:54.682277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a63cbcb4-c702-4135-9a11-98b4469ad045 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:54.690368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a63cbcb4-c702-4135-9a11-98b4469ad045 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082600 Jun 02 16:38:54.690928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 990/2219] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:54 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:55.373376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a8a35ce9-3151-43dd-8978-2e1be876b390 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:55.374014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a8a35ce9-3151-43dd-8978-2e1be876b390 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:55.380679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a8a35ce9-3151-43dd-8978-2e1be876b390 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:55.381217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a8a35ce9-3151-43dd-8978-2e1be876b390 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:55.381982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a8a35ce9-3151-43dd-8978-2e1be876b390 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:55.382474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a8a35ce9-3151-43dd-8978-2e1be876b390 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:55.444203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a8a35ce9-3151-43dd-8978-2e1be876b390 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:55.452726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a8a35ce9-3151-43dd-8978-2e1be876b390 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084068 Jun 02 16:38:55.453287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1230/2220] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:55 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:55.707408 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f7a7689f-26be-46da-ad55-61686bab455a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:55.708020 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f7a7689f-26be-46da-ad55-61686bab455a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:55.715376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f7a7689f-26be-46da-ad55-61686bab455a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:55.715824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f7a7689f-26be-46da-ad55-61686bab455a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:55.716587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f7a7689f-26be-46da-ad55-61686bab455a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:55.717024 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f7a7689f-26be-46da-ad55-61686bab455a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:55.780812 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f7a7689f-26be-46da-ad55-61686bab455a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:55.788790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f7a7689f-26be-46da-ad55-61686bab455a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085254 Jun 02 16:38:55.789356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 991/2221] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:56.470202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d3f09418-0d2f-4e11-a55e-f85029698d0b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:56.470774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d3f09418-0d2f-4e11-a55e-f85029698d0b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:56.477120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d3f09418-0d2f-4e11-a55e-f85029698d0b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:56.477565 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d3f09418-0d2f-4e11-a55e-f85029698d0b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:56.478335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d3f09418-0d2f-4e11-a55e-f85029698d0b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:56.478768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d3f09418-0d2f-4e11-a55e-f85029698d0b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:56.542902 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d3f09418-0d2f-4e11-a55e-f85029698d0b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:56.550968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d3f09418-0d2f-4e11-a55e-f85029698d0b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084772 Jun 02 16:38:56.551530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1231/2222] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:56 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:56.806168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-24969ad9-790e-40f2-9492-db06b07ad770 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:56.806702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-24969ad9-790e-40f2-9492-db06b07ad770 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:56.814328 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24969ad9-790e-40f2-9492-db06b07ad770 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:56.814774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24969ad9-790e-40f2-9492-db06b07ad770 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:56.815533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24969ad9-790e-40f2-9492-db06b07ad770 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:56.815965 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-24969ad9-790e-40f2-9492-db06b07ad770 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:56.880558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-24969ad9-790e-40f2-9492-db06b07ad770 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:56.888502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-24969ad9-790e-40f2-9492-db06b07ad770 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086256 Jun 02 16:38:56.889061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 992/2223] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:57.568804 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b0a8ad8d-64dd-4bbf-a5b0-e4a5f81864b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:57.569444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b0a8ad8d-64dd-4bbf-a5b0-e4a5f81864b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:57.576019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0a8ad8d-64dd-4bbf-a5b0-e4a5f81864b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:57.576471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0a8ad8d-64dd-4bbf-a5b0-e4a5f81864b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:57.577227 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0a8ad8d-64dd-4bbf-a5b0-e4a5f81864b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:57.577666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0a8ad8d-64dd-4bbf-a5b0-e4a5f81864b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:57.652313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b0a8ad8d-64dd-4bbf-a5b0-e4a5f81864b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:57.652313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b0a8ad8d-64dd-4bbf-a5b0-e4a5f81864b1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081449 Jun 02 16:38:57.652313 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1232/2224] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:57 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:57.906064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-766e967c-3e87-4341-9959-e26b9e862ca4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:57.906727 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-766e967c-3e87-4341-9959-e26b9e862ca4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:57.913206 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-766e967c-3e87-4341-9959-e26b9e862ca4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:57.913643 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-766e967c-3e87-4341-9959-e26b9e862ca4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:57.914434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-766e967c-3e87-4341-9959-e26b9e862ca4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:57.914865 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-766e967c-3e87-4341-9959-e26b9e862ca4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:57.976578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-766e967c-3e87-4341-9959-e26b9e862ca4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:57.984559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-766e967c-3e87-4341-9959-e26b9e862ca4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082577 Jun 02 16:38:57.985115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 993/2225] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:57 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:58.667887 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2ab70c32-aa0b-4156-be4f-e4a589733be3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:58.668446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2ab70c32-aa0b-4156-be4f-e4a589733be3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:58.674908 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ab70c32-aa0b-4156-be4f-e4a589733be3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:58.675356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ab70c32-aa0b-4156-be4f-e4a589733be3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:58.676115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ab70c32-aa0b-4156-be4f-e4a589733be3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:58.676577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2ab70c32-aa0b-4156-be4f-e4a589733be3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:58.737482 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2ab70c32-aa0b-4156-be4f-e4a589733be3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:58.746358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2ab70c32-aa0b-4156-be4f-e4a589733be3 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082775 Jun 02 16:38:58.747146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1233/2226] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:58 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:59.001444 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-70c71900-ec69-4f15-93d3-b02740d93330 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:59.002060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-70c71900-ec69-4f15-93d3-b02740d93330 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:59.008471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-70c71900-ec69-4f15-93d3-b02740d93330 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:59.008922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-70c71900-ec69-4f15-93d3-b02740d93330 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:59.009683 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-70c71900-ec69-4f15-93d3-b02740d93330 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:59.010153 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-70c71900-ec69-4f15-93d3-b02740d93330 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:59.070698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-70c71900-ec69-4f15-93d3-b02740d93330 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:59.078567 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-70c71900-ec69-4f15-93d3-b02740d93330 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.080950 Jun 02 16:38:59.079135 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 994/2227] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:58 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:38:59.764483 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c7fc6fac-060f-4e5d-afea-3718f0fef557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:38:59.765125 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c7fc6fac-060f-4e5d-afea-3718f0fef557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:38:59.771568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7fc6fac-060f-4e5d-afea-3718f0fef557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:59.772019 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7fc6fac-060f-4e5d-afea-3718f0fef557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:59.772778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7fc6fac-060f-4e5d-afea-3718f0fef557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:38:59.773246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c7fc6fac-060f-4e5d-afea-3718f0fef557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:38:59.777712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:38:59.835654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c7fc6fac-060f-4e5d-afea-3718f0fef557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:38:59.844947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c7fc6fac-060f-4e5d-afea-3718f0fef557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084646 Jun 02 16:38:59.845535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1234/2228] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:38:59 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:00.095618 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a17c0f2d-0fd6-4719-87a0-001087057857 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:00.096159 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a17c0f2d-0fd6-4719-87a0-001087057857 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:00.102663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a17c0f2d-0fd6-4719-87a0-001087057857 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:00.103101 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a17c0f2d-0fd6-4719-87a0-001087057857 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:00.103867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a17c0f2d-0fd6-4719-87a0-001087057857 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:00.104936 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a17c0f2d-0fd6-4719-87a0-001087057857 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:00.165895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a17c0f2d-0fd6-4719-87a0-001087057857 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:00.174025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a17c0f2d-0fd6-4719-87a0-001087057857 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082229 Jun 02 16:39:00.174633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 995/2229] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:00.862914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a8fd135d-b6b6-43c0-bd69-8acc75006671 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:00.863515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a8fd135d-b6b6-43c0-bd69-8acc75006671 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:00.870491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a8fd135d-b6b6-43c0-bd69-8acc75006671 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:00.871085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a8fd135d-b6b6-43c0-bd69-8acc75006671 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:00.871834 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a8fd135d-b6b6-43c0-bd69-8acc75006671 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:00.872264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a8fd135d-b6b6-43c0-bd69-8acc75006671 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:00.937240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a8fd135d-b6b6-43c0-bd69-8acc75006671 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:00.945036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a8fd135d-b6b6-43c0-bd69-8acc75006671 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.086043 Jun 02 16:39:00.945590 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1235/2230] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:00 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:01.191389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-09a76947-97b9-4a6e-b579-01f43627074f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:01.192003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-09a76947-97b9-4a6e-b579-01f43627074f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:01.198599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09a76947-97b9-4a6e-b579-01f43627074f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:01.199051 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09a76947-97b9-4a6e-b579-01f43627074f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:01.199815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09a76947-97b9-4a6e-b579-01f43627074f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:01.200251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-09a76947-97b9-4a6e-b579-01f43627074f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:01.263599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-09a76947-97b9-4a6e-b579-01f43627074f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:01.271521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-09a76947-97b9-4a6e-b579-01f43627074f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083993 Jun 02 16:39:01.272083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 996/2231] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:01 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:01.962251 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9e0710a3-4547-4342-88d4-cccc24bded5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:01.962866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9e0710a3-4547-4342-88d4-cccc24bded5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:01.970297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e0710a3-4547-4342-88d4-cccc24bded5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:01.970752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e0710a3-4547-4342-88d4-cccc24bded5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:01.971516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e0710a3-4547-4342-88d4-cccc24bded5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:01.971956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e0710a3-4547-4342-88d4-cccc24bded5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:02.031921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9e0710a3-4547-4342-88d4-cccc24bded5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:02.039768 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9e0710a3-4547-4342-88d4-cccc24bded5b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081695 Jun 02 16:39:02.040326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1236/2232] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:01 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:02.288799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ef5194a1-85b6-4c6a-b588-337a60817d62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:02.289357 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ef5194a1-85b6-4c6a-b588-337a60817d62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:02.295992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef5194a1-85b6-4c6a-b588-337a60817d62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:02.296444 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef5194a1-85b6-4c6a-b588-337a60817d62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:02.297207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef5194a1-85b6-4c6a-b588-337a60817d62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:02.297649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ef5194a1-85b6-4c6a-b588-337a60817d62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:02.359386 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ef5194a1-85b6-4c6a-b588-337a60817d62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:02.367279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ef5194a1-85b6-4c6a-b588-337a60817d62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082396 Jun 02 16:39:02.367841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 997/2233] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:03.057095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-36a721cb-de43-4a0e-bba2-9455295ffd0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:03.057874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-36a721cb-de43-4a0e-bba2-9455295ffd0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:03.065000 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36a721cb-de43-4a0e-bba2-9455295ffd0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:03.065455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36a721cb-de43-4a0e-bba2-9455295ffd0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:03.066249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36a721cb-de43-4a0e-bba2-9455295ffd0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:03.066693 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-36a721cb-de43-4a0e-bba2-9455295ffd0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:03.127893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-36a721cb-de43-4a0e-bba2-9455295ffd0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:03.136502 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-36a721cb-de43-4a0e-bba2-9455295ffd0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082596 Jun 02 16:39:03.137530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1237/2234] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:03 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:03.386712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8a4e375b-9f70-4e15-975b-2f995421873d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:03.387282 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8a4e375b-9f70-4e15-975b-2f995421873d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:03.393850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a4e375b-9f70-4e15-975b-2f995421873d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:03.394342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a4e375b-9f70-4e15-975b-2f995421873d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:03.395119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a4e375b-9f70-4e15-975b-2f995421873d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:03.395558 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a4e375b-9f70-4e15-975b-2f995421873d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:03.459151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8a4e375b-9f70-4e15-975b-2f995421873d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:03.468602 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8a4e375b-9f70-4e15-975b-2f995421873d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086773 Jun 02 16:39:03.469173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 998/2235] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:03 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:04.153895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fa3d2815-aee8-444a-80bc-6077d09bc6fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:04.154534 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fa3d2815-aee8-444a-80bc-6077d09bc6fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:04.160889 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa3d2815-aee8-444a-80bc-6077d09bc6fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:04.161328 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa3d2815-aee8-444a-80bc-6077d09bc6fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:04.162099 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa3d2815-aee8-444a-80bc-6077d09bc6fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:04.162537 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa3d2815-aee8-444a-80bc-6077d09bc6fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:04.224765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fa3d2815-aee8-444a-80bc-6077d09bc6fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:04.233319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fa3d2815-aee8-444a-80bc-6077d09bc6fd tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083423 Jun 02 16:39:04.233888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1238/2236] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:04 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:04.485921 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-49203475-fd78-46a6-8f2c-bda5a03d3987 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:04.486575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-49203475-fd78-46a6-8f2c-bda5a03d3987 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:04.493005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-49203475-fd78-46a6-8f2c-bda5a03d3987 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:04.493448 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-49203475-fd78-46a6-8f2c-bda5a03d3987 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:04.494238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-49203475-fd78-46a6-8f2c-bda5a03d3987 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:04.494672 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-49203475-fd78-46a6-8f2c-bda5a03d3987 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:04.726823 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-49203475-fd78-46a6-8f2c-bda5a03d3987 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:04.734797 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-49203475-fd78-46a6-8f2c-bda5a03d3987 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.252703 Jun 02 16:39:04.735367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 999/2237] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:04 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:05.250940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d1497cfc-bd49-487d-bf0b-44c018a5afb9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:05.251557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d1497cfc-bd49-487d-bf0b-44c018a5afb9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:05.257954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1497cfc-bd49-487d-bf0b-44c018a5afb9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:05.258438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1497cfc-bd49-487d-bf0b-44c018a5afb9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:05.259196 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1497cfc-bd49-487d-bf0b-44c018a5afb9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:05.259631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d1497cfc-bd49-487d-bf0b-44c018a5afb9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:05.322444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d1497cfc-bd49-487d-bf0b-44c018a5afb9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:05.331298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d1497cfc-bd49-487d-bf0b-44c018a5afb9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084256 Jun 02 16:39:05.331859 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1239/2238] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:05 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:05.751790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c02afe21-78fa-48de-b555-fb56915e6328 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:05.759497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c02afe21-78fa-48de-b555-fb56915e6328 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:05.759497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c02afe21-78fa-48de-b555-fb56915e6328 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:05.759497 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c02afe21-78fa-48de-b555-fb56915e6328 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:05.760109 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c02afe21-78fa-48de-b555-fb56915e6328 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:05.760577 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c02afe21-78fa-48de-b555-fb56915e6328 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:05.829872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c02afe21-78fa-48de-b555-fb56915e6328 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:05.838550 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c02afe21-78fa-48de-b555-fb56915e6328 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.090729 Jun 02 16:39:05.840119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1000/2239] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:06.348559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3be28cc8-b9b6-4f19-8063-13ea6bc40bc6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:06.349175 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3be28cc8-b9b6-4f19-8063-13ea6bc40bc6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:06.355965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3be28cc8-b9b6-4f19-8063-13ea6bc40bc6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:06.356414 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3be28cc8-b9b6-4f19-8063-13ea6bc40bc6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:06.357186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3be28cc8-b9b6-4f19-8063-13ea6bc40bc6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:06.357666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3be28cc8-b9b6-4f19-8063-13ea6bc40bc6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:06.418085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3be28cc8-b9b6-4f19-8063-13ea6bc40bc6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:06.426090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3be28cc8-b9b6-4f19-8063-13ea6bc40bc6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081313 Jun 02 16:39:06.426602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1240/2240] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:06 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:06.857310 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b05899fc-9858-4e4f-8e6d-60c3fd7d3f44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:06.857883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b05899fc-9858-4e4f-8e6d-60c3fd7d3f44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:06.864401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b05899fc-9858-4e4f-8e6d-60c3fd7d3f44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:06.864852 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b05899fc-9858-4e4f-8e6d-60c3fd7d3f44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:06.865620 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b05899fc-9858-4e4f-8e6d-60c3fd7d3f44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:06.866060 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b05899fc-9858-4e4f-8e6d-60c3fd7d3f44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:06.925920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b05899fc-9858-4e4f-8e6d-60c3fd7d3f44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:06.934573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b05899fc-9858-4e4f-8e6d-60c3fd7d3f44 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081830 Jun 02 16:39:06.935124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1001/2241] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:07.443035 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-102173cd-fff5-403b-a0ac-34e6bf449b3e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:07.443652 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-102173cd-fff5-403b-a0ac-34e6bf449b3e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:07.450190 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-102173cd-fff5-403b-a0ac-34e6bf449b3e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:07.450637 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-102173cd-fff5-403b-a0ac-34e6bf449b3e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:07.451393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-102173cd-fff5-403b-a0ac-34e6bf449b3e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:07.451826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-102173cd-fff5-403b-a0ac-34e6bf449b3e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:07.514146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-102173cd-fff5-403b-a0ac-34e6bf449b3e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:07.520319 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-102173cd-fff5-403b-a0ac-34e6bf449b3e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081176 Jun 02 16:39:07.520881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1241/2242] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:07 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:07.952078 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8364e77b-c1ab-4127-8e35-83c23a0d0fbb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:07.952751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8364e77b-c1ab-4127-8e35-83c23a0d0fbb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:07.959332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8364e77b-c1ab-4127-8e35-83c23a0d0fbb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:07.959731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8364e77b-c1ab-4127-8e35-83c23a0d0fbb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:07.960502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8364e77b-c1ab-4127-8e35-83c23a0d0fbb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:07.961206 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8364e77b-c1ab-4127-8e35-83c23a0d0fbb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:08.022573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8364e77b-c1ab-4127-8e35-83c23a0d0fbb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:08.030491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8364e77b-c1ab-4127-8e35-83c23a0d0fbb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082919 Jun 02 16:39:08.031043 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1002/2243] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:08.537954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e17aeba7-65e5-4bbc-9f8e-763b47952839 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:08.538616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e17aeba7-65e5-4bbc-9f8e-763b47952839 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:08.545743 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e17aeba7-65e5-4bbc-9f8e-763b47952839 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:08.546215 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e17aeba7-65e5-4bbc-9f8e-763b47952839 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:08.546973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e17aeba7-65e5-4bbc-9f8e-763b47952839 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:08.547410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e17aeba7-65e5-4bbc-9f8e-763b47952839 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:08.609255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e17aeba7-65e5-4bbc-9f8e-763b47952839 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:08.616989 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e17aeba7-65e5-4bbc-9f8e-763b47952839 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082889 Jun 02 16:39:08.617549 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1242/2244] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:08 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:09.047416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3aa0d159-d79d-45a0-a092-55290af3571f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:09.048033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3aa0d159-d79d-45a0-a092-55290af3571f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:09.054512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3aa0d159-d79d-45a0-a092-55290af3571f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:09.054968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3aa0d159-d79d-45a0-a092-55290af3571f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:09.055742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3aa0d159-d79d-45a0-a092-55290af3571f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:09.056186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3aa0d159-d79d-45a0-a092-55290af3571f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:09.117883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3aa0d159-d79d-45a0-a092-55290af3571f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:09.126990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3aa0d159-d79d-45a0-a092-55290af3571f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083405 Jun 02 16:39:09.127549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1003/2245] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:09.634796 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-efcb4574-ed50-49b7-8e8a-dd93817eb8a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:09.635517 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-efcb4574-ed50-49b7-8e8a-dd93817eb8a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:09.641839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-efcb4574-ed50-49b7-8e8a-dd93817eb8a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:09.642326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-efcb4574-ed50-49b7-8e8a-dd93817eb8a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:09.643082 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-efcb4574-ed50-49b7-8e8a-dd93817eb8a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:09.643518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-efcb4574-ed50-49b7-8e8a-dd93817eb8a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:09.707516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-efcb4574-ed50-49b7-8e8a-dd93817eb8a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:09.716214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-efcb4574-ed50-49b7-8e8a-dd93817eb8a9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.085335 Jun 02 16:39:09.716775 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1243/2246] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:09 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:10.144587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-941feb0b-3e25-42f6-b76d-4d1920026646 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:10.145204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-941feb0b-3e25-42f6-b76d-4d1920026646 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:10.152289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-941feb0b-3e25-42f6-b76d-4d1920026646 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:10.152740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-941feb0b-3e25-42f6-b76d-4d1920026646 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:10.153500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-941feb0b-3e25-42f6-b76d-4d1920026646 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:10.153939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-941feb0b-3e25-42f6-b76d-4d1920026646 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:10.217941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-941feb0b-3e25-42f6-b76d-4d1920026646 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:10.225802 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-941feb0b-3e25-42f6-b76d-4d1920026646 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085144 Jun 02 16:39:10.226591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1004/2247] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:10 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:10.733513 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6f1cd0c5-baaa-4d62-93aa-23e5f75a9bb2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:10.734159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6f1cd0c5-baaa-4d62-93aa-23e5f75a9bb2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:10.740676 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f1cd0c5-baaa-4d62-93aa-23e5f75a9bb2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:10.741127 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f1cd0c5-baaa-4d62-93aa-23e5f75a9bb2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:10.741892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f1cd0c5-baaa-4d62-93aa-23e5f75a9bb2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:10.742358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6f1cd0c5-baaa-4d62-93aa-23e5f75a9bb2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:10.802861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6f1cd0c5-baaa-4d62-93aa-23e5f75a9bb2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:10.812182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6f1cd0c5-baaa-4d62-93aa-23e5f75a9bb2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083353 Jun 02 16:39:10.812752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1244/2248] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:10 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:11.242674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9f6225e3-98bd-4888-9c27-cb086109bf78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:11.243293 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9f6225e3-98bd-4888-9c27-cb086109bf78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:11.250340 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f6225e3-98bd-4888-9c27-cb086109bf78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:11.250797 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f6225e3-98bd-4888-9c27-cb086109bf78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:11.251592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f6225e3-98bd-4888-9c27-cb086109bf78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:11.252033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f6225e3-98bd-4888-9c27-cb086109bf78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:11.313996 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9f6225e3-98bd-4888-9c27-cb086109bf78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:11.321959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9f6225e3-98bd-4888-9c27-cb086109bf78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083173 Jun 02 16:39:11.322543 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1005/2249] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:11 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:11.834316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dc36cf1f-4f93-437d-b159-553867a09c3d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:11.834929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dc36cf1f-4f93-437d-b159-553867a09c3d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:11.842555 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc36cf1f-4f93-437d-b159-553867a09c3d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:11.843001 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc36cf1f-4f93-437d-b159-553867a09c3d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:11.843761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc36cf1f-4f93-437d-b159-553867a09c3d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:11.844199 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dc36cf1f-4f93-437d-b159-553867a09c3d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:11.904843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-dc36cf1f-4f93-437d-b159-553867a09c3d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:11.912760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dc36cf1f-4f93-437d-b159-553867a09c3d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082310 Jun 02 16:39:11.913324 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1245/2250] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:11 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:12.340660 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c5018a95-86a1-44a5-8d55-4225f847db65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:12.341280 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c5018a95-86a1-44a5-8d55-4225f847db65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:12.347768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c5018a95-86a1-44a5-8d55-4225f847db65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:12.348223 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c5018a95-86a1-44a5-8d55-4225f847db65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:12.348990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c5018a95-86a1-44a5-8d55-4225f847db65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:12.349433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c5018a95-86a1-44a5-8d55-4225f847db65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:12.364251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:12.412619 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c5018a95-86a1-44a5-8d55-4225f847db65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:12.422613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c5018a95-86a1-44a5-8d55-4225f847db65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087070 Jun 02 16:39:12.423078 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1006/2251] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:12.931688 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a5e9635f-1205-46f3-83cb-de7482abf08e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:12.933107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a5e9635f-1205-46f3-83cb-de7482abf08e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:12.939705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5e9635f-1205-46f3-83cb-de7482abf08e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:12.940157 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5e9635f-1205-46f3-83cb-de7482abf08e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:12.940921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5e9635f-1205-46f3-83cb-de7482abf08e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:12.941366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a5e9635f-1205-46f3-83cb-de7482abf08e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:13.008441 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a5e9635f-1205-46f3-83cb-de7482abf08e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:13.016357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a5e9635f-1205-46f3-83cb-de7482abf08e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.089239 Jun 02 16:39:13.016907 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1246/2252] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:12 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:13.439669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-060868e7-1f3a-4dd4-a9e8-294b7853f246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:13.440290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-060868e7-1f3a-4dd4-a9e8-294b7853f246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:13.446834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-060868e7-1f3a-4dd4-a9e8-294b7853f246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:13.447286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-060868e7-1f3a-4dd4-a9e8-294b7853f246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:13.448238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-060868e7-1f3a-4dd4-a9e8-294b7853f246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:13.448676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-060868e7-1f3a-4dd4-a9e8-294b7853f246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:13.511311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-060868e7-1f3a-4dd4-a9e8-294b7853f246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:13.519301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-060868e7-1f3a-4dd4-a9e8-294b7853f246 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083749 Jun 02 16:39:13.519869 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1007/2253] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:13 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:14.032915 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a2e87edb-c883-4e10-9b88-9a8992094ee1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:14.033531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a2e87edb-c883-4e10-9b88-9a8992094ee1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:14.040655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2e87edb-c883-4e10-9b88-9a8992094ee1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:14.041108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2e87edb-c883-4e10-9b88-9a8992094ee1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:14.042197 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2e87edb-c883-4e10-9b88-9a8992094ee1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:14.042819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a2e87edb-c883-4e10-9b88-9a8992094ee1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:14.108600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a2e87edb-c883-4e10-9b88-9a8992094ee1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:14.116771 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a2e87edb-c883-4e10-9b88-9a8992094ee1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.087760 Jun 02 16:39:14.117338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1247/2254] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:14 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:14.540044 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1e17ab1b-24ed-41c6-99d7-5477101e0bf6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:14.540640 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1e17ab1b-24ed-41c6-99d7-5477101e0bf6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:14.547808 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e17ab1b-24ed-41c6-99d7-5477101e0bf6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:14.548259 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e17ab1b-24ed-41c6-99d7-5477101e0bf6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:14.549027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e17ab1b-24ed-41c6-99d7-5477101e0bf6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:14.549464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1e17ab1b-24ed-41c6-99d7-5477101e0bf6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:14.613092 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1e17ab1b-24ed-41c6-99d7-5477101e0bf6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:14.621775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1e17ab1b-24ed-41c6-99d7-5477101e0bf6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085578 Jun 02 16:39:14.622365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1008/2255] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:15.139186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-993e92ed-541c-4f0e-9403-488bc503e558 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:15.139792 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-993e92ed-541c-4f0e-9403-488bc503e558 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:15.145716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-993e92ed-541c-4f0e-9403-488bc503e558 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:15.146198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-993e92ed-541c-4f0e-9403-488bc503e558 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:15.146976 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-993e92ed-541c-4f0e-9403-488bc503e558 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:15.147404 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-993e92ed-541c-4f0e-9403-488bc503e558 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:15.210034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-993e92ed-541c-4f0e-9403-488bc503e558 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:15.218842 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-993e92ed-541c-4f0e-9403-488bc503e558 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084211 Jun 02 16:39:15.219406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1248/2256] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:15 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:15.639149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-04576628-4bf8-421f-90ed-f0e1ce256d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:15.639768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-04576628-4bf8-421f-90ed-f0e1ce256d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:15.645922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-04576628-4bf8-421f-90ed-f0e1ce256d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:15.646409 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-04576628-4bf8-421f-90ed-f0e1ce256d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:15.647178 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-04576628-4bf8-421f-90ed-f0e1ce256d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:15.647623 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-04576628-4bf8-421f-90ed-f0e1ce256d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:15.708171 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-04576628-4bf8-421f-90ed-f0e1ce256d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:15.716538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-04576628-4bf8-421f-90ed-f0e1ce256d01 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081819 Jun 02 16:39:15.717115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1009/2257] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:15 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:16.235812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-11af3c8b-ce5e-4f02-824c-0c4b4efa4bb1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:16.236414 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-11af3c8b-ce5e-4f02-824c-0c4b4efa4bb1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:16.242820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11af3c8b-ce5e-4f02-824c-0c4b4efa4bb1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:16.243264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11af3c8b-ce5e-4f02-824c-0c4b4efa4bb1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:16.244012 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11af3c8b-ce5e-4f02-824c-0c4b4efa4bb1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:16.244446 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-11af3c8b-ce5e-4f02-824c-0c4b4efa4bb1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:16.304470 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-11af3c8b-ce5e-4f02-824c-0c4b4efa4bb1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:16.312516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-11af3c8b-ce5e-4f02-824c-0c4b4efa4bb1 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.080527 Jun 02 16:39:16.313074 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1249/2258] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:16 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:16.733026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bb12023f-eece-42e3-b14c-e5b165576cef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:16.733649 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bb12023f-eece-42e3-b14c-e5b165576cef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:16.740219 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bb12023f-eece-42e3-b14c-e5b165576cef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:16.740677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bb12023f-eece-42e3-b14c-e5b165576cef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:16.741442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bb12023f-eece-42e3-b14c-e5b165576cef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:16.741883 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bb12023f-eece-42e3-b14c-e5b165576cef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:16.804411 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bb12023f-eece-42e3-b14c-e5b165576cef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:16.812706 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bb12023f-eece-42e3-b14c-e5b165576cef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083764 Jun 02 16:39:16.813264 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1010/2259] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:17.329872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-187e7f99-50a2-47ef-9c56-2ce9b4a4b56b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:17.330504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-187e7f99-50a2-47ef-9c56-2ce9b4a4b56b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:17.337160 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-187e7f99-50a2-47ef-9c56-2ce9b4a4b56b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:17.337601 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-187e7f99-50a2-47ef-9c56-2ce9b4a4b56b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:17.338493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-187e7f99-50a2-47ef-9c56-2ce9b4a4b56b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:17.338927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-187e7f99-50a2-47ef-9c56-2ce9b4a4b56b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:17.399830 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-187e7f99-50a2-47ef-9c56-2ce9b4a4b56b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:17.401991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:17.408353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-187e7f99-50a2-47ef-9c56-2ce9b4a4b56b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082317 Jun 02 16:39:17.408901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1250/2260] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:17 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:17.829702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5041b2ea-ff77-4b6d-b201-42c25a887844 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:17.830327 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5041b2ea-ff77-4b6d-b201-42c25a887844 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:17.837031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5041b2ea-ff77-4b6d-b201-42c25a887844 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:17.837480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5041b2ea-ff77-4b6d-b201-42c25a887844 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:17.838895 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5041b2ea-ff77-4b6d-b201-42c25a887844 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:17.839338 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5041b2ea-ff77-4b6d-b201-42c25a887844 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:17.899423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5041b2ea-ff77-4b6d-b201-42c25a887844 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:17.907828 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5041b2ea-ff77-4b6d-b201-42c25a887844 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081963 Jun 02 16:39:17.909163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1011/2261] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:18.426316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5a4facfc-ece1-4472-9660-fac5d45158b2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:18.426855 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5a4facfc-ece1-4472-9660-fac5d45158b2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:18.433543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a4facfc-ece1-4472-9660-fac5d45158b2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:18.433983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a4facfc-ece1-4472-9660-fac5d45158b2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:18.434755 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a4facfc-ece1-4472-9660-fac5d45158b2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:18.435184 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5a4facfc-ece1-4472-9660-fac5d45158b2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:18.499941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5a4facfc-ece1-4472-9660-fac5d45158b2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:18.507813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5a4facfc-ece1-4472-9660-fac5d45158b2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.085496 Jun 02 16:39:18.508403 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1251/2262] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:18 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:18.925326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1bef6883-37c4-463a-8ae4-92f4af151daa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:18.925971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1bef6883-37c4-463a-8ae4-92f4af151daa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:18.928351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=56 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:18.933805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1bef6883-37c4-463a-8ae4-92f4af151daa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:18.934292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1bef6883-37c4-463a-8ae4-92f4af151daa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:18.935062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1bef6883-37c4-463a-8ae4-92f4af151daa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:18.935503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1bef6883-37c4-463a-8ae4-92f4af151daa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:19.001560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1bef6883-37c4-463a-8ae4-92f4af151daa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:19.009464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1bef6883-37c4-463a-8ae4-92f4af151daa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.088059 Jun 02 16:39:19.010147 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1012/2263] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:19.525923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dad61fda-4936-4c0f-b2f9-bc7998e5345c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:19.526729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dad61fda-4936-4c0f-b2f9-bc7998e5345c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:19.533390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dad61fda-4936-4c0f-b2f9-bc7998e5345c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:19.533846 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dad61fda-4936-4c0f-b2f9-bc7998e5345c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:19.534639 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dad61fda-4936-4c0f-b2f9-bc7998e5345c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:19.535078 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dad61fda-4936-4c0f-b2f9-bc7998e5345c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:19.596697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-dad61fda-4936-4c0f-b2f9-bc7998e5345c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:19.604795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dad61fda-4936-4c0f-b2f9-bc7998e5345c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083396 Jun 02 16:39:19.605358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1252/2264] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:19 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:20.026856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e3ab84c6-fdee-474c-89d8-5bac3270386f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:20.027451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e3ab84c6-fdee-474c-89d8-5bac3270386f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:20.033975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e3ab84c6-fdee-474c-89d8-5bac3270386f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:20.034506 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e3ab84c6-fdee-474c-89d8-5bac3270386f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:20.035275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e3ab84c6-fdee-474c-89d8-5bac3270386f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:20.035719 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e3ab84c6-fdee-474c-89d8-5bac3270386f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:20.096691 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e3ab84c6-fdee-474c-89d8-5bac3270386f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:20.105025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e3ab84c6-fdee-474c-89d8-5bac3270386f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082161 Jun 02 16:39:20.105584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1013/2265] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:20.622701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ce34ebeb-7196-45e2-8c38-48eb4def3a28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:20.623263 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ce34ebeb-7196-45e2-8c38-48eb4def3a28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:20.625530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=56 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:20.630258 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce34ebeb-7196-45e2-8c38-48eb4def3a28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:20.630711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce34ebeb-7196-45e2-8c38-48eb4def3a28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:20.631501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce34ebeb-7196-45e2-8c38-48eb4def3a28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:20.631936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ce34ebeb-7196-45e2-8c38-48eb4def3a28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:20.693306 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ce34ebeb-7196-45e2-8c38-48eb4def3a28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:20.701611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ce34ebeb-7196-45e2-8c38-48eb4def3a28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083579 Jun 02 16:39:20.702201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1253/2266] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:20 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:21.122100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-234ec0bf-144d-4828-a112-678f0db46657 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:21.122722 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-234ec0bf-144d-4828-a112-678f0db46657 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:21.129114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-234ec0bf-144d-4828-a112-678f0db46657 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:21.129553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-234ec0bf-144d-4828-a112-678f0db46657 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:21.130333 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-234ec0bf-144d-4828-a112-678f0db46657 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:21.130766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-234ec0bf-144d-4828-a112-678f0db46657 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:21.191827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-234ec0bf-144d-4828-a112-678f0db46657 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:21.200187 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-234ec0bf-144d-4828-a112-678f0db46657 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082210 Jun 02 16:39:21.200742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1014/2267] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:21.719244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6dd8229c-13b8-47be-8afb-40c0dd65bc13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:21.719860 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6dd8229c-13b8-47be-8afb-40c0dd65bc13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:21.726264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dd8229c-13b8-47be-8afb-40c0dd65bc13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:21.726749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dd8229c-13b8-47be-8afb-40c0dd65bc13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:21.727509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dd8229c-13b8-47be-8afb-40c0dd65bc13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:21.727942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6dd8229c-13b8-47be-8afb-40c0dd65bc13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:21.789610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6dd8229c-13b8-47be-8afb-40c0dd65bc13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:21.797535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6dd8229c-13b8-47be-8afb-40c0dd65bc13 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082460 Jun 02 16:39:21.798117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1254/2268] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:21 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:22.217442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d13e8f80-7e9e-408f-bbdd-bf96c65166fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:22.218061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d13e8f80-7e9e-408f-bbdd-bf96c65166fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:22.224521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d13e8f80-7e9e-408f-bbdd-bf96c65166fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:22.224969 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d13e8f80-7e9e-408f-bbdd-bf96c65166fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:22.225733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d13e8f80-7e9e-408f-bbdd-bf96c65166fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:22.226203 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d13e8f80-7e9e-408f-bbdd-bf96c65166fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:22.285750 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d13e8f80-7e9e-408f-bbdd-bf96c65166fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:22.294571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d13e8f80-7e9e-408f-bbdd-bf96c65166fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081487 Jun 02 16:39:22.295133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1015/2269] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:22.814977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ddac0fb8-c1e8-4a60-9c0a-e56f85977f65 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:22.815625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ddac0fb8-c1e8-4a60-9c0a-e56f85977f65 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:22.822553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddac0fb8-c1e8-4a60-9c0a-e56f85977f65 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:22.823010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddac0fb8-c1e8-4a60-9c0a-e56f85977f65 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:22.823764 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddac0fb8-c1e8-4a60-9c0a-e56f85977f65 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:22.824202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddac0fb8-c1e8-4a60-9c0a-e56f85977f65 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:22.890779 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ddac0fb8-c1e8-4a60-9c0a-e56f85977f65 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:22.898977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ddac0fb8-c1e8-4a60-9c0a-e56f85977f65 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.087721 Jun 02 16:39:22.899535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1255/2270] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:22 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:23.312059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-826e12f9-2e8e-46d5-8e93-3dffe64ec3a8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:23.312677 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-826e12f9-2e8e-46d5-8e93-3dffe64ec3a8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:23.319120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-826e12f9-2e8e-46d5-8e93-3dffe64ec3a8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:23.319569 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-826e12f9-2e8e-46d5-8e93-3dffe64ec3a8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:23.320325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-826e12f9-2e8e-46d5-8e93-3dffe64ec3a8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:23.320762 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-826e12f9-2e8e-46d5-8e93-3dffe64ec3a8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:23.387118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-826e12f9-2e8e-46d5-8e93-3dffe64ec3a8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:23.395188 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-826e12f9-2e8e-46d5-8e93-3dffe64ec3a8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087157 Jun 02 16:39:23.395763 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1016/2271] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:23.917610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ff0487bb-4a1d-47be-845e-41522b433c03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:23.918249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ff0487bb-4a1d-47be-845e-41522b433c03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:23.924699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ff0487bb-4a1d-47be-845e-41522b433c03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:23.925147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ff0487bb-4a1d-47be-845e-41522b433c03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:23.925895 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ff0487bb-4a1d-47be-845e-41522b433c03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:23.926349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ff0487bb-4a1d-47be-845e-41522b433c03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:23.988276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ff0487bb-4a1d-47be-845e-41522b433c03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:23.996204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ff0487bb-4a1d-47be-845e-41522b433c03 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083257 Jun 02 16:39:23.996762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1256/2272] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:23 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:24.412055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-52db1b2f-4c11-406c-86fb-29af40286630 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:24.412689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-52db1b2f-4c11-406c-86fb-29af40286630 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:24.419378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52db1b2f-4c11-406c-86fb-29af40286630 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:24.419832 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52db1b2f-4c11-406c-86fb-29af40286630 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:24.420610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52db1b2f-4c11-406c-86fb-29af40286630 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:24.421054 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52db1b2f-4c11-406c-86fb-29af40286630 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:24.482107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-52db1b2f-4c11-406c-86fb-29af40286630 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:24.490029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-52db1b2f-4c11-406c-86fb-29af40286630 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081853 Jun 02 16:39:24.490604 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1017/2273] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:25.013781 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ca9f97db-16d2-4f83-9104-a12bb6b26502 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:25.014433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ca9f97db-16d2-4f83-9104-a12bb6b26502 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:25.020882 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca9f97db-16d2-4f83-9104-a12bb6b26502 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:25.021336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca9f97db-16d2-4f83-9104-a12bb6b26502 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:25.022119 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca9f97db-16d2-4f83-9104-a12bb6b26502 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:25.022562 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ca9f97db-16d2-4f83-9104-a12bb6b26502 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:25.083065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ca9f97db-16d2-4f83-9104-a12bb6b26502 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:25.091763 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ca9f97db-16d2-4f83-9104-a12bb6b26502 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081950 Jun 02 16:39:25.092325 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1257/2274] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:25 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:25.508350 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-28c89b85-74d6-4ad6-bd11-307756b630b3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:25.508972 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-28c89b85-74d6-4ad6-bd11-307756b630b3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:25.517177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28c89b85-74d6-4ad6-bd11-307756b630b3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:25.517631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28c89b85-74d6-4ad6-bd11-307756b630b3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:25.518440 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28c89b85-74d6-4ad6-bd11-307756b630b3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:25.518887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28c89b85-74d6-4ad6-bd11-307756b630b3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:25.582417 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-28c89b85-74d6-4ad6-bd11-307756b630b3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:25.590632 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-28c89b85-74d6-4ad6-bd11-307756b630b3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086357 Jun 02 16:39:25.591237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1018/2275] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:25 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:26.111475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dd12212b-e35f-434d-8792-e727ef04c02f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:26.112112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dd12212b-e35f-434d-8792-e727ef04c02f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:26.118584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dd12212b-e35f-434d-8792-e727ef04c02f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:26.119273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dd12212b-e35f-434d-8792-e727ef04c02f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:26.120131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dd12212b-e35f-434d-8792-e727ef04c02f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:26.120573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dd12212b-e35f-434d-8792-e727ef04c02f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:26.183442 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-dd12212b-e35f-434d-8792-e727ef04c02f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:26.191496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dd12212b-e35f-434d-8792-e727ef04c02f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.085337 Jun 02 16:39:26.192065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1258/2276] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:26 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:26.607480 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e73d9250-50fb-477a-b78f-da11c5320ba1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:26.608095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e73d9250-50fb-477a-b78f-da11c5320ba1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:26.614536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e73d9250-50fb-477a-b78f-da11c5320ba1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:26.614985 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e73d9250-50fb-477a-b78f-da11c5320ba1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:26.615742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e73d9250-50fb-477a-b78f-da11c5320ba1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:26.616174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e73d9250-50fb-477a-b78f-da11c5320ba1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:26.676752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e73d9250-50fb-477a-b78f-da11c5320ba1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:26.684642 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e73d9250-50fb-477a-b78f-da11c5320ba1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081027 Jun 02 16:39:26.685194 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1019/2277] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:27.208654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4630f253-1900-4e21-b848-f11a0975caf9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:27.209256 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4630f253-1900-4e21-b848-f11a0975caf9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:27.216052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4630f253-1900-4e21-b848-f11a0975caf9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:27.216496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4630f253-1900-4e21-b848-f11a0975caf9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:27.217240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4630f253-1900-4e21-b848-f11a0975caf9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:27.217666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4630f253-1900-4e21-b848-f11a0975caf9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:27.280126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4630f253-1900-4e21-b848-f11a0975caf9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:27.287941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4630f253-1900-4e21-b848-f11a0975caf9 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083084 Jun 02 16:39:27.288499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1259/2278] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:27 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:27.701320 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-41ed8716-6788-471d-9375-7cbc99b4220c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:27.701927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-41ed8716-6788-471d-9375-7cbc99b4220c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:27.708527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ed8716-6788-471d-9375-7cbc99b4220c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:27.708977 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ed8716-6788-471d-9375-7cbc99b4220c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:27.709741 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ed8716-6788-471d-9375-7cbc99b4220c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:27.710195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41ed8716-6788-471d-9375-7cbc99b4220c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:27.779305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-41ed8716-6788-471d-9375-7cbc99b4220c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:27.783658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-41ed8716-6788-471d-9375-7cbc99b4220c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086728 Jun 02 16:39:27.784222 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1020/2279] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:28.305202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-77996f2f-394d-449f-a320-f4cca759eb24 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:28.305916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-77996f2f-394d-449f-a320-f4cca759eb24 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:28.312862 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77996f2f-394d-449f-a320-f4cca759eb24 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:28.313309 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77996f2f-394d-449f-a320-f4cca759eb24 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:28.314058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77996f2f-394d-449f-a320-f4cca759eb24 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:28.314509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-77996f2f-394d-449f-a320-f4cca759eb24 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:28.374957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-77996f2f-394d-449f-a320-f4cca759eb24 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:28.382638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-77996f2f-394d-449f-a320-f4cca759eb24 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081257 Jun 02 16:39:28.383188 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1260/2280] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:28 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:28.800682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b9fb51b8-faba-48b7-a42e-218a41b846ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:28.801322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b9fb51b8-faba-48b7-a42e-218a41b846ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:28.808485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b9fb51b8-faba-48b7-a42e-218a41b846ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:28.808931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b9fb51b8-faba-48b7-a42e-218a41b846ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:28.809687 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b9fb51b8-faba-48b7-a42e-218a41b846ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:28.810152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b9fb51b8-faba-48b7-a42e-218a41b846ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:28.871007 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b9fb51b8-faba-48b7-a42e-218a41b846ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:28.878924 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b9fb51b8-faba-48b7-a42e-218a41b846ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082103 Jun 02 16:39:28.879483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1021/2281] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:29.400824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-248fc269-37bc-41c2-880a-791fb38912bb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:29.401376 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-248fc269-37bc-41c2-880a-791fb38912bb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:29.407912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-248fc269-37bc-41c2-880a-791fb38912bb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:29.408365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-248fc269-37bc-41c2-880a-791fb38912bb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:29.409127 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-248fc269-37bc-41c2-880a-791fb38912bb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:29.409567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-248fc269-37bc-41c2-880a-791fb38912bb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:29.471903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-248fc269-37bc-41c2-880a-791fb38912bb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:29.479863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-248fc269-37bc-41c2-880a-791fb38912bb tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083605 Jun 02 16:39:29.480449 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1261/2282] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:29 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:29.895916 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b358e826-6feb-454b-a741-1a87287b9686 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:29.896534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b358e826-6feb-454b-a741-1a87287b9686 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:29.903161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b358e826-6feb-454b-a741-1a87287b9686 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:29.903613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b358e826-6feb-454b-a741-1a87287b9686 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:29.904421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b358e826-6feb-454b-a741-1a87287b9686 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:29.904856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b358e826-6feb-454b-a741-1a87287b9686 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:29.966468 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b358e826-6feb-454b-a741-1a87287b9686 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:29.974631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b358e826-6feb-454b-a741-1a87287b9686 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082734 Jun 02 16:39:29.975198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1022/2283] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:30.497106 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ddce5133-2313-464e-9e5f-3d35298826d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:30.497654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ddce5133-2313-464e-9e5f-3d35298826d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:30.504304 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddce5133-2313-464e-9e5f-3d35298826d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:30.504757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddce5133-2313-464e-9e5f-3d35298826d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:30.505519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddce5133-2313-464e-9e5f-3d35298826d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:30.505957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddce5133-2313-464e-9e5f-3d35298826d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:30.566783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ddce5133-2313-464e-9e5f-3d35298826d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:30.575173 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ddce5133-2313-464e-9e5f-3d35298826d6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.082368 Jun 02 16:39:30.575735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1262/2284] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:30 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:30.991776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-463b8ed9-69e9-4c8b-a70f-ad2d362bc3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:30.992387 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-463b8ed9-69e9-4c8b-a70f-ad2d362bc3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:30.998577 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-463b8ed9-69e9-4c8b-a70f-ad2d362bc3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:30.999029 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-463b8ed9-69e9-4c8b-a70f-ad2d362bc3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:30.999796 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-463b8ed9-69e9-4c8b-a70f-ad2d362bc3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:31.000231 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-463b8ed9-69e9-4c8b-a70f-ad2d362bc3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:31.002752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:31.061829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-463b8ed9-69e9-4c8b-a70f-ad2d362bc3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:31.069636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-463b8ed9-69e9-4c8b-a70f-ad2d362bc3d8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081738 Jun 02 16:39:31.070210 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1023/2285] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:31.592384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-eaf90623-17fd-42a4-bb18-c58180f7d623 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:31.592998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-eaf90623-17fd-42a4-bb18-c58180f7d623 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:31.599509 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eaf90623-17fd-42a4-bb18-c58180f7d623 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:31.599962 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eaf90623-17fd-42a4-bb18-c58180f7d623 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:31.600719 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eaf90623-17fd-42a4-bb18-c58180f7d623 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:31.601155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-eaf90623-17fd-42a4-bb18-c58180f7d623 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:31.666760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-eaf90623-17fd-42a4-bb18-c58180f7d623 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:31.674368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-eaf90623-17fd-42a4-bb18-c58180f7d623 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.085810 Jun 02 16:39:31.674929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1263/2286] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:31 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:32.086401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9cb3c6bd-aedf-4d62-956c-d3cbf4e0ded6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:32.087616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9cb3c6bd-aedf-4d62-956c-d3cbf4e0ded6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:32.094311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cb3c6bd-aedf-4d62-956c-d3cbf4e0ded6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:32.094757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cb3c6bd-aedf-4d62-956c-d3cbf4e0ded6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:32.095521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cb3c6bd-aedf-4d62-956c-d3cbf4e0ded6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:32.095954 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9cb3c6bd-aedf-4d62-956c-d3cbf4e0ded6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:32.160891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9cb3c6bd-aedf-4d62-956c-d3cbf4e0ded6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:32.169982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9cb3c6bd-aedf-4d62-956c-d3cbf4e0ded6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087764 Jun 02 16:39:32.170585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1024/2287] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:32.692011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a76a8fdd-a460-4043-9057-dacba1b43ae2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:32.692626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a76a8fdd-a460-4043-9057-dacba1b43ae2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:32.699603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a76a8fdd-a460-4043-9057-dacba1b43ae2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:32.700058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a76a8fdd-a460-4043-9057-dacba1b43ae2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:32.700813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a76a8fdd-a460-4043-9057-dacba1b43ae2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:32.701249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a76a8fdd-a460-4043-9057-dacba1b43ae2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:32.761673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a76a8fdd-a460-4043-9057-dacba1b43ae2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:32.769553 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a76a8fdd-a460-4043-9057-dacba1b43ae2 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081411 Jun 02 16:39:32.770135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1264/2288] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:32 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:33.186989 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-491fdd77-84b6-4847-a84e-a6321ecffa45 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:33.187635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-491fdd77-84b6-4847-a84e-a6321ecffa45 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:33.193805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-491fdd77-84b6-4847-a84e-a6321ecffa45 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:33.194283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-491fdd77-84b6-4847-a84e-a6321ecffa45 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:33.195049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-491fdd77-84b6-4847-a84e-a6321ecffa45 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:33.195483 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-491fdd77-84b6-4847-a84e-a6321ecffa45 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:33.255559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-491fdd77-84b6-4847-a84e-a6321ecffa45 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:33.264012 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-491fdd77-84b6-4847-a84e-a6321ecffa45 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.080890 Jun 02 16:39:33.264573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1025/2289] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:33.787290 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9a584f07-029f-47e9-8d37-7c94a88e4557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:33.787905 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9a584f07-029f-47e9-8d37-7c94a88e4557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:33.794554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a584f07-029f-47e9-8d37-7c94a88e4557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:33.795010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a584f07-029f-47e9-8d37-7c94a88e4557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:33.795770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a584f07-029f-47e9-8d37-7c94a88e4557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:33.796213 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9a584f07-029f-47e9-8d37-7c94a88e4557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:33.857174 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9a584f07-029f-47e9-8d37-7c94a88e4557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:33.865045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9a584f07-029f-47e9-8d37-7c94a88e4557 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081663 Jun 02 16:39:33.865608 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1265/2290] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:33 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:34.280062 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8ca6a991-1801-4546-b52b-842e46fe268c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:34.280801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8ca6a991-1801-4546-b52b-842e46fe268c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:34.287418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ca6a991-1801-4546-b52b-842e46fe268c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:34.287872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ca6a991-1801-4546-b52b-842e46fe268c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:34.288636 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ca6a991-1801-4546-b52b-842e46fe268c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:34.289076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8ca6a991-1801-4546-b52b-842e46fe268c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:34.350463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8ca6a991-1801-4546-b52b-842e46fe268c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:34.358585 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8ca6a991-1801-4546-b52b-842e46fe268c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082388 Jun 02 16:39:34.359144 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1026/2291] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:34.882543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1ae213f7-d037-4266-b9a8-2e612c14085b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:34.883143 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1ae213f7-d037-4266-b9a8-2e612c14085b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:34.889599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1ae213f7-d037-4266-b9a8-2e612c14085b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:34.890042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1ae213f7-d037-4266-b9a8-2e612c14085b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:34.890817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1ae213f7-d037-4266-b9a8-2e612c14085b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:34.891247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1ae213f7-d037-4266-b9a8-2e612c14085b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:34.951112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1ae213f7-d037-4266-b9a8-2e612c14085b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:34.958877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1ae213f7-d037-4266-b9a8-2e612c14085b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.080165 Jun 02 16:39:34.959428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1266/2292] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:34 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:35.375322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f8fdf341-eb4f-4514-9f33-1a7e90d47631 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:35.375933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f8fdf341-eb4f-4514-9f33-1a7e90d47631 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:35.382473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8fdf341-eb4f-4514-9f33-1a7e90d47631 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:35.382914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8fdf341-eb4f-4514-9f33-1a7e90d47631 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:35.383666 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8fdf341-eb4f-4514-9f33-1a7e90d47631 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:35.384350 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f8fdf341-eb4f-4514-9f33-1a7e90d47631 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:35.444976 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f8fdf341-eb4f-4514-9f33-1a7e90d47631 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:35.453095 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f8fdf341-eb4f-4514-9f33-1a7e90d47631 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081617 Jun 02 16:39:35.453699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1027/2293] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:35 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:35.976349 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6ad70db8-21c4-4b54-89f9-9bffd9a51e46 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:35.976968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6ad70db8-21c4-4b54-89f9-9bffd9a51e46 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:35.984326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ad70db8-21c4-4b54-89f9-9bffd9a51e46 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:35.984783 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ad70db8-21c4-4b54-89f9-9bffd9a51e46 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:35.985554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ad70db8-21c4-4b54-89f9-9bffd9a51e46 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:35.985993 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6ad70db8-21c4-4b54-89f9-9bffd9a51e46 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:36.000966 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:36.050472 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6ad70db8-21c4-4b54-89f9-9bffd9a51e46 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:36.058818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6ad70db8-21c4-4b54-89f9-9bffd9a51e46 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.086362 Jun 02 16:39:36.059388 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1267/2294] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:35 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:36.469487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2a8e5858-d8f8-45b8-8dee-21ae19a72a93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:36.470131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2a8e5858-d8f8-45b8-8dee-21ae19a72a93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:36.476641 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2a8e5858-d8f8-45b8-8dee-21ae19a72a93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:36.477103 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2a8e5858-d8f8-45b8-8dee-21ae19a72a93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:36.478378 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2a8e5858-d8f8-45b8-8dee-21ae19a72a93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:36.478841 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2a8e5858-d8f8-45b8-8dee-21ae19a72a93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:36.542622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2a8e5858-d8f8-45b8-8dee-21ae19a72a93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:36.550537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2a8e5858-d8f8-45b8-8dee-21ae19a72a93 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084975 Jun 02 16:39:36.551099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1028/2295] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:36 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:37.076052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-bf2a2728-b85d-48c6-add8-766d1500a219 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:37.076675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-bf2a2728-b85d-48c6-add8-766d1500a219 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:37.083247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf2a2728-b85d-48c6-add8-766d1500a219 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:37.083707 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf2a2728-b85d-48c6-add8-766d1500a219 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:37.084501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf2a2728-b85d-48c6-add8-766d1500a219 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:37.084939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-bf2a2728-b85d-48c6-add8-766d1500a219 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:37.148207 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-bf2a2728-b85d-48c6-add8-766d1500a219 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:37.156386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-bf2a2728-b85d-48c6-add8-766d1500a219 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.084350 Jun 02 16:39:37.156957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1268/2296] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:37 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:37.568489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-83baf0e0-9080-4d84-8e4d-bff31c1115dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:37.569143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-83baf0e0-9080-4d84-8e4d-bff31c1115dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:37.576744 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83baf0e0-9080-4d84-8e4d-bff31c1115dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:37.577199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83baf0e0-9080-4d84-8e4d-bff31c1115dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:37.577968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83baf0e0-9080-4d84-8e4d-bff31c1115dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:37.578438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-83baf0e0-9080-4d84-8e4d-bff31c1115dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:37.639385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-83baf0e0-9080-4d84-8e4d-bff31c1115dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:37.647230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-83baf0e0-9080-4d84-8e4d-bff31c1115dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082646 Jun 02 16:39:37.647786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1029/2297] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:37 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:38.173847 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1b9b9362-91a3-4402-8a54-f968ce5b6fe6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:38.174492 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1b9b9362-91a3-4402-8a54-f968ce5b6fe6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:38.181519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1b9b9362-91a3-4402-8a54-f968ce5b6fe6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:38.181968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1b9b9362-91a3-4402-8a54-f968ce5b6fe6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:38.182760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1b9b9362-91a3-4402-8a54-f968ce5b6fe6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:38.183195 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1b9b9362-91a3-4402-8a54-f968ce5b6fe6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:38.243600 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1b9b9362-91a3-4402-8a54-f968ce5b6fe6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:38.251417 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1b9b9362-91a3-4402-8a54-f968ce5b6fe6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081474 Jun 02 16:39:38.251980 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1269/2298] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:38 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:38.665424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fb8b6c8b-48b5-4fe5-a3f7-e67ebdc12a3d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:38.666166 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fb8b6c8b-48b5-4fe5-a3f7-e67ebdc12a3d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:38.672546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fb8b6c8b-48b5-4fe5-a3f7-e67ebdc12a3d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:38.672998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fb8b6c8b-48b5-4fe5-a3f7-e67ebdc12a3d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:38.673760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fb8b6c8b-48b5-4fe5-a3f7-e67ebdc12a3d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:38.674239 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fb8b6c8b-48b5-4fe5-a3f7-e67ebdc12a3d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:38.735084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fb8b6c8b-48b5-4fe5-a3f7-e67ebdc12a3d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:38.743040 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fb8b6c8b-48b5-4fe5-a3f7-e67ebdc12a3d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082097 Jun 02 16:39:38.743682 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1030/2299] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:38 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:39.268275 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f54986ca-79e0-4deb-88f3-ca6ffc37f254 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:39.268894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f54986ca-79e0-4deb-88f3-ca6ffc37f254 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:39.276067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f54986ca-79e0-4deb-88f3-ca6ffc37f254 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:39.276520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f54986ca-79e0-4deb-88f3-ca6ffc37f254 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:39.277278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f54986ca-79e0-4deb-88f3-ca6ffc37f254 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:39.277724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f54986ca-79e0-4deb-88f3-ca6ffc37f254 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:39.338464 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f54986ca-79e0-4deb-88f3-ca6ffc37f254 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:39.346415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f54986ca-79e0-4deb-88f3-ca6ffc37f254 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081905 Jun 02 16:39:39.346979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1270/2300] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:39 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:39.760696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a5da9ab3-8453-41a0-b6f6-44308026218b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:39.761311 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a5da9ab3-8453-41a0-b6f6-44308026218b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:39.767981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5da9ab3-8453-41a0-b6f6-44308026218b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:39.768438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5da9ab3-8453-41a0-b6f6-44308026218b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:39.769206 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5da9ab3-8453-41a0-b6f6-44308026218b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:39.769650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a5da9ab3-8453-41a0-b6f6-44308026218b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:39.831437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a5da9ab3-8453-41a0-b6f6-44308026218b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:39.839678 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a5da9ab3-8453-41a0-b6f6-44308026218b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083513 Jun 02 16:39:39.840236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1031/2301] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:40.363350 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6fbfa45f-ef51-4b67-a983-070a3d3ff25a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:40.363955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6fbfa45f-ef51-4b67-a983-070a3d3ff25a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:40.370466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6fbfa45f-ef51-4b67-a983-070a3d3ff25a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:40.370914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6fbfa45f-ef51-4b67-a983-070a3d3ff25a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:40.371690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6fbfa45f-ef51-4b67-a983-070a3d3ff25a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:40.372121 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6fbfa45f-ef51-4b67-a983-070a3d3ff25a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:40.435499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6fbfa45f-ef51-4b67-a983-070a3d3ff25a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:40.443430 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6fbfa45f-ef51-4b67-a983-070a3d3ff25a tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.083973 Jun 02 16:39:40.443991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1271/2302] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:40 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:40.856950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f9e3e12d-7659-4a50-a348-f08462283a4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:40.857515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f9e3e12d-7659-4a50-a348-f08462283a4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:40.864033 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f9e3e12d-7659-4a50-a348-f08462283a4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:40.864487 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f9e3e12d-7659-4a50-a348-f08462283a4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:40.865251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f9e3e12d-7659-4a50-a348-f08462283a4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:40.865686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f9e3e12d-7659-4a50-a348-f08462283a4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:40.929112 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f9e3e12d-7659-4a50-a348-f08462283a4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:40.937509 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f9e3e12d-7659-4a50-a348-f08462283a4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084555 Jun 02 16:39:40.938089 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1032/2303] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:41.460690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-554823d2-11f6-49fa-8382-f06f5b0a3d0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:41.461309 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-554823d2-11f6-49fa-8382-f06f5b0a3d0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:41.468004 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-554823d2-11f6-49fa-8382-f06f5b0a3d0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:41.468456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-554823d2-11f6-49fa-8382-f06f5b0a3d0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:41.469217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-554823d2-11f6-49fa-8382-f06f5b0a3d0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:41.469655 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-554823d2-11f6-49fa-8382-f06f5b0a3d0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:41.529539 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-554823d2-11f6-49fa-8382-f06f5b0a3d0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:41.537291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-554823d2-11f6-49fa-8382-f06f5b0a3d0d tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.080792 Jun 02 16:39:41.537856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1272/2304] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:41 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:41.955131 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-518f4178-6325-44a2-a9a2-70d94394404a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:41.955731 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-518f4178-6325-44a2-a9a2-70d94394404a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:41.963079 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-518f4178-6325-44a2-a9a2-70d94394404a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:41.963528 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-518f4178-6325-44a2-a9a2-70d94394404a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:41.964289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-518f4178-6325-44a2-a9a2-70d94394404a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:41.964761 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-518f4178-6325-44a2-a9a2-70d94394404a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:42.025904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-518f4178-6325-44a2-a9a2-70d94394404a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:42.033806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-518f4178-6325-44a2-a9a2-70d94394404a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082603 Jun 02 16:39:42.034401 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1033/2305] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:42.555852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-738f7db3-e232-4840-984f-0c573aa7d599 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:42.556518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-738f7db3-e232-4840-984f-0c573aa7d599 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:42.562888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-738f7db3-e232-4840-984f-0c573aa7d599 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:42.563338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-738f7db3-e232-4840-984f-0c573aa7d599 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:42.564092 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-738f7db3-e232-4840-984f-0c573aa7d599 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:42.564525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-738f7db3-e232-4840-984f-0c573aa7d599 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:42.624576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-738f7db3-e232-4840-984f-0c573aa7d599 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:42.632451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-738f7db3-e232-4840-984f-0c573aa7d599 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.081042 Jun 02 16:39:42.633003 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1273/2306] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:42 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:43.051325 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-27e22e49-c79c-4333-af7c-aecabce3c74c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:43.051988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-27e22e49-c79c-4333-af7c-aecabce3c74c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:43.059187 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-27e22e49-c79c-4333-af7c-aecabce3c74c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:43.059634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-27e22e49-c79c-4333-af7c-aecabce3c74c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:43.060395 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-27e22e49-c79c-4333-af7c-aecabce3c74c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:43.060827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-27e22e49-c79c-4333-af7c-aecabce3c74c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:43.122137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-27e22e49-c79c-4333-af7c-aecabce3c74c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:43.130173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-27e22e49-c79c-4333-af7c-aecabce3c74c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082630 Jun 02 16:39:43.130732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1034/2307] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:43 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:43.651206 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-17c6ad6a-30dc-4dd7-aa9f-e8942123a8ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:43.651798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-17c6ad6a-30dc-4dd7-aa9f-e8942123a8ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 6d9f21d8-cd12-4d8c-8dc7-765453991dcb] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:43.658276 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-17c6ad6a-30dc-4dd7-aa9f-e8942123a8ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:43.658729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-17c6ad6a-30dc-4dd7-aa9f-e8942123a8ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:43.659507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-17c6ad6a-30dc-4dd7-aa9f-e8942123a8ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:43.659953 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-17c6ad6a-30dc-4dd7-aa9f-e8942123a8ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:43.724320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-17c6ad6a-30dc-4dd7-aa9f-e8942123a8ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:43.732484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-17c6ad6a-30dc-4dd7-aa9f-e8942123a8ff tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb" status: 200 len: 1349 microversion: 2.1 time: 0.085817 Jun 02 16:39:43.733046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1274/2308] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:43 2022] GET /compute/v2.1/servers/6d9f21d8-cd12-4d8c-8dc7-765453991dcb => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:44.147398 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c4f23f2a-2e53-4217-a1a9-f1beb56e8dac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:44.148026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c4f23f2a-2e53-4217-a1a9-f1beb56e8dac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:44.154552 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4f23f2a-2e53-4217-a1a9-f1beb56e8dac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:44.155005 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4f23f2a-2e53-4217-a1a9-f1beb56e8dac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:44.155769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4f23f2a-2e53-4217-a1a9-f1beb56e8dac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:44.156207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c4f23f2a-2e53-4217-a1a9-f1beb56e8dac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:44.218302 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c4f23f2a-2e53-4217-a1a9-f1beb56e8dac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:44.226177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c4f23f2a-2e53-4217-a1a9-f1beb56e8dac tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082652 Jun 02 16:39:44.226737 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1035/2309] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:44 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:45.243261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-5e434b05-51e0-40dc-8137-f4d94119790c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:45.244056 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-5e434b05-51e0-40dc-8137-f4d94119790c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:45.250400 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e434b05-51e0-40dc-8137-f4d94119790c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:45.250851 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e434b05-51e0-40dc-8137-f4d94119790c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:45.251616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e434b05-51e0-40dc-8137-f4d94119790c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:45.252051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-5e434b05-51e0-40dc-8137-f4d94119790c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:45.315496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-5e434b05-51e0-40dc-8137-f4d94119790c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:45.323566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-5e434b05-51e0-40dc-8137-f4d94119790c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084632 Jun 02 16:39:45.324347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1275/2310] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:46.342230 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cb70789f-8450-4425-aa42-b7e7224beab8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:46.342847 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cb70789f-8450-4425-aa42-b7e7224beab8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:46.349132 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb70789f-8450-4425-aa42-b7e7224beab8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:46.354708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb70789f-8450-4425-aa42-b7e7224beab8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:46.354708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb70789f-8450-4425-aa42-b7e7224beab8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:46.354708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb70789f-8450-4425-aa42-b7e7224beab8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:46.414210 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cb70789f-8450-4425-aa42-b7e7224beab8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:46.423251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cb70789f-8450-4425-aa42-b7e7224beab8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084926 Jun 02 16:39:46.423784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1036/2311] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:47.440746 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-468bf1d2-cce9-46af-bdd0-e1ff7d761d36 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:47.441361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-468bf1d2-cce9-46af-bdd0-e1ff7d761d36 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:47.448034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-468bf1d2-cce9-46af-bdd0-e1ff7d761d36 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:47.448487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-468bf1d2-cce9-46af-bdd0-e1ff7d761d36 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:47.449250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-468bf1d2-cce9-46af-bdd0-e1ff7d761d36 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:47.449689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-468bf1d2-cce9-46af-bdd0-e1ff7d761d36 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:47.510874 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-468bf1d2-cce9-46af-bdd0-e1ff7d761d36 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:47.518702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-468bf1d2-cce9-46af-bdd0-e1ff7d761d36 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081888 Jun 02 16:39:47.519264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1276/2312] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:47 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:48.535624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c441547d-c550-498c-8d83-144b8e35305b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:48.536238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c441547d-c550-498c-8d83-144b8e35305b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:48.543420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c441547d-c550-498c-8d83-144b8e35305b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:48.543872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c441547d-c550-498c-8d83-144b8e35305b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:48.544647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c441547d-c550-498c-8d83-144b8e35305b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:48.545084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c441547d-c550-498c-8d83-144b8e35305b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:48.606723 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c441547d-c550-498c-8d83-144b8e35305b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:48.614675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c441547d-c550-498c-8d83-144b8e35305b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082963 Jun 02 16:39:48.615236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1037/2313] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:48 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:49.631570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d9031269-dc61-4f87-991c-5c2f8178b562 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:49.632186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d9031269-dc61-4f87-991c-5c2f8178b562 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:49.639267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9031269-dc61-4f87-991c-5c2f8178b562 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:49.639726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9031269-dc61-4f87-991c-5c2f8178b562 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:49.640501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9031269-dc61-4f87-991c-5c2f8178b562 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:49.640939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d9031269-dc61-4f87-991c-5c2f8178b562 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:49.701305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d9031269-dc61-4f87-991c-5c2f8178b562 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:49.709155 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d9031269-dc61-4f87-991c-5c2f8178b562 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081516 Jun 02 16:39:49.709713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1277/2314] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:50.727438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9205ecfa-3123-44f0-8253-fe173c0473fc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:50.728086 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9205ecfa-3123-44f0-8253-fe173c0473fc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:50.730455 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=52 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:50.735218 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9205ecfa-3123-44f0-8253-fe173c0473fc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:50.735674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9205ecfa-3123-44f0-8253-fe173c0473fc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:50.736446 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9205ecfa-3123-44f0-8253-fe173c0473fc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:50.736886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9205ecfa-3123-44f0-8253-fe173c0473fc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:50.799804 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9205ecfa-3123-44f0-8253-fe173c0473fc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:50.808271 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9205ecfa-3123-44f0-8253-fe173c0473fc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084842 Jun 02 16:39:50.808838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1038/2315] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:50.909759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:39:50.910311 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:39:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:39:51.825896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-37f1bb01-2aaa-449b-9732-3b265bf6e5ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:51.826523 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-37f1bb01-2aaa-449b-9732-3b265bf6e5ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:51.828947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=50 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:51.833588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37f1bb01-2aaa-449b-9732-3b265bf6e5ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:51.834060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37f1bb01-2aaa-449b-9732-3b265bf6e5ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:51.834844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37f1bb01-2aaa-449b-9732-3b265bf6e5ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:51.835516 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37f1bb01-2aaa-449b-9732-3b265bf6e5ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:51.896955 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-37f1bb01-2aaa-449b-9732-3b265bf6e5ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:51.905228 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-37f1bb01-2aaa-449b-9732-3b265bf6e5ee tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083192 Jun 02 16:39:51.905780 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1278/2316] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:39:52.404506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:39:52.405137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:39:52.922100 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4b0b3b8f-64ee-45bd-87ba-0672986299fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:52.922695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4b0b3b8f-64ee-45bd-87ba-0672986299fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:52.929313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b0b3b8f-64ee-45bd-87ba-0672986299fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:52.930688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b0b3b8f-64ee-45bd-87ba-0672986299fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:52.931572 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b0b3b8f-64ee-45bd-87ba-0672986299fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:52.932017 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4b0b3b8f-64ee-45bd-87ba-0672986299fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:52.994245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4b0b3b8f-64ee-45bd-87ba-0672986299fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:52.996455 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:39:53.002747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4b0b3b8f-64ee-45bd-87ba-0672986299fd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084536 Jun 02 16:39:53.003313 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1039/2317] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:52 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:54.020489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6992ea30-97b6-4da8-b566-3d251454719a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:54.021104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6992ea30-97b6-4da8-b566-3d251454719a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:54.028259 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6992ea30-97b6-4da8-b566-3d251454719a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:54.028713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6992ea30-97b6-4da8-b566-3d251454719a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:54.029478 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6992ea30-97b6-4da8-b566-3d251454719a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:54.029916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6992ea30-97b6-4da8-b566-3d251454719a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:54.094897 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6992ea30-97b6-4da8-b566-3d251454719a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:54.103368 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6992ea30-97b6-4da8-b566-3d251454719a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086716 Jun 02 16:39:54.103920 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1279/2318] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:54 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:55.120186 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-90bf4042-40dd-42dd-a597-6a2551d05a22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:55.120804 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-90bf4042-40dd-42dd-a597-6a2551d05a22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:55.127780 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-90bf4042-40dd-42dd-a597-6a2551d05a22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:55.128227 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-90bf4042-40dd-42dd-a597-6a2551d05a22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:55.129372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-90bf4042-40dd-42dd-a597-6a2551d05a22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:55.129486 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-90bf4042-40dd-42dd-a597-6a2551d05a22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:55.193046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-90bf4042-40dd-42dd-a597-6a2551d05a22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:55.202145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-90bf4042-40dd-42dd-a597-6a2551d05a22 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085807 Jun 02 16:39:55.202739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1040/2319] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:56.220278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e452f70a-e114-4770-8231-a9c2077ade78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:56.220893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e452f70a-e114-4770-8231-a9c2077ade78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:56.228798 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e452f70a-e114-4770-8231-a9c2077ade78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:56.229246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e452f70a-e114-4770-8231-a9c2077ade78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:56.230016 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e452f70a-e114-4770-8231-a9c2077ade78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:56.230477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e452f70a-e114-4770-8231-a9c2077ade78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:56.291843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e452f70a-e114-4770-8231-a9c2077ade78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:56.299667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e452f70a-e114-4770-8231-a9c2077ade78 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083121 Jun 02 16:39:56.300220 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1280/2320] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:57.316014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5a401b83-bc37-48cf-b114-33f3994dc579 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:57.316631 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5a401b83-bc37-48cf-b114-33f3994dc579 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:57.323575 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a401b83-bc37-48cf-b114-33f3994dc579 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:57.324028 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a401b83-bc37-48cf-b114-33f3994dc579 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:57.324798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a401b83-bc37-48cf-b114-33f3994dc579 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:57.325236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5a401b83-bc37-48cf-b114-33f3994dc579 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:57.386600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5a401b83-bc37-48cf-b114-33f3994dc579 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:57.394414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5a401b83-bc37-48cf-b114-33f3994dc579 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082229 Jun 02 16:39:57.394979 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1041/2321] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:57 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:58.411576 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-59495ff0-f6e5-4310-92b2-2ae76e6b5c27 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:58.412193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-59495ff0-f6e5-4310-92b2-2ae76e6b5c27 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:58.419406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59495ff0-f6e5-4310-92b2-2ae76e6b5c27 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:58.419861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59495ff0-f6e5-4310-92b2-2ae76e6b5c27 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:58.420625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59495ff0-f6e5-4310-92b2-2ae76e6b5c27 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:58.421070 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-59495ff0-f6e5-4310-92b2-2ae76e6b5c27 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:58.483848 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-59495ff0-f6e5-4310-92b2-2ae76e6b5c27 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:58.491797 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-59495ff0-f6e5-4310-92b2-2ae76e6b5c27 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084018 Jun 02 16:39:58.492448 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1281/2322] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:58 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:39:59.510273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e799d230-eb0a-4d9b-a703-59fb158c8cf3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:39:59.510872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e799d230-eb0a-4d9b-a703-59fb158c8cf3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:39:59.517438 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e799d230-eb0a-4d9b-a703-59fb158c8cf3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:59.517891 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e799d230-eb0a-4d9b-a703-59fb158c8cf3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:59.518705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e799d230-eb0a-4d9b-a703-59fb158c8cf3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:39:59.519144 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e799d230-eb0a-4d9b-a703-59fb158c8cf3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:39:59.579694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e799d230-eb0a-4d9b-a703-59fb158c8cf3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:39:59.588004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e799d230-eb0a-4d9b-a703-59fb158c8cf3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082315 Jun 02 16:39:59.588571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1042/2323] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:39:59 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:00.111568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:40:00.111835 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:40:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:40:00.605187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3674497a-3b52-4216-bd52-3b9a7a43829c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:00.605824 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3674497a-3b52-4216-bd52-3b9a7a43829c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:00.612310 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3674497a-3b52-4216-bd52-3b9a7a43829c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:00.612753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3674497a-3b52-4216-bd52-3b9a7a43829c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:00.613498 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3674497a-3b52-4216-bd52-3b9a7a43829c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:00.613931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3674497a-3b52-4216-bd52-3b9a7a43829c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:00.674587 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3674497a-3b52-4216-bd52-3b9a7a43829c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:00.682894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3674497a-3b52-4216-bd52-3b9a7a43829c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082035 Jun 02 16:40:00.683454 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1282/2324] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:01.700606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ab197436-26b6-4091-9c8b-7a58b8fca2f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:01.701283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ab197436-26b6-4091-9c8b-7a58b8fca2f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:01.708061 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ab197436-26b6-4091-9c8b-7a58b8fca2f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:01.708515 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ab197436-26b6-4091-9c8b-7a58b8fca2f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:01.709278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ab197436-26b6-4091-9c8b-7a58b8fca2f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:01.709710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ab197436-26b6-4091-9c8b-7a58b8fca2f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:01.772318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ab197436-26b6-4091-9c8b-7a58b8fca2f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:01.780819 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ab197436-26b6-4091-9c8b-7a58b8fca2f4 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084841 Jun 02 16:40:01.781376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1043/2325] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:01 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:02.797474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-407e2d9f-0857-43e5-95c2-233173c7808e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:02.798108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-407e2d9f-0857-43e5-95c2-233173c7808e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:02.804730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-407e2d9f-0857-43e5-95c2-233173c7808e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:02.805183 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-407e2d9f-0857-43e5-95c2-233173c7808e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:02.806984 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-407e2d9f-0857-43e5-95c2-233173c7808e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:02.807428 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-407e2d9f-0857-43e5-95c2-233173c7808e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:02.870958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-407e2d9f-0857-43e5-95c2-233173c7808e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:02.878697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-407e2d9f-0857-43e5-95c2-233173c7808e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085079 Jun 02 16:40:02.879250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1283/2326] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:03.896077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b7d1a386-08b5-4ceb-a201-25900a0ec7ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:03.896690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b7d1a386-08b5-4ceb-a201-25900a0ec7ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:03.903801 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b7d1a386-08b5-4ceb-a201-25900a0ec7ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:03.904250 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b7d1a386-08b5-4ceb-a201-25900a0ec7ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:03.905004 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b7d1a386-08b5-4ceb-a201-25900a0ec7ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:03.905437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b7d1a386-08b5-4ceb-a201-25900a0ec7ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:03.969228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b7d1a386-08b5-4ceb-a201-25900a0ec7ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:03.977077 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b7d1a386-08b5-4ceb-a201-25900a0ec7ea tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084855 Jun 02 16:40:03.977861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1044/2327] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:03 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:04.993657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8cd9ee9f-206d-4136-bc73-f9be4aab9f30 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:04.994318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8cd9ee9f-206d-4136-bc73-f9be4aab9f30 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:05.000769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8cd9ee9f-206d-4136-bc73-f9be4aab9f30 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:05.001221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8cd9ee9f-206d-4136-bc73-f9be4aab9f30 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:05.001978 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8cd9ee9f-206d-4136-bc73-f9be4aab9f30 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:05.002444 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8cd9ee9f-206d-4136-bc73-f9be4aab9f30 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:05.006262 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=100 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:40:05.307187 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8cd9ee9f-206d-4136-bc73-f9be4aab9f30 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:05.315224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8cd9ee9f-206d-4136-bc73-f9be4aab9f30 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.325797 Jun 02 16:40:05.315782 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1284/2328] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:04 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:06.332551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4a5dbf08-4ddb-4789-bdc9-4200f1b6eb07 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:06.333158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4a5dbf08-4ddb-4789-bdc9-4200f1b6eb07 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:06.340456 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a5dbf08-4ddb-4789-bdc9-4200f1b6eb07 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:06.340903 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a5dbf08-4ddb-4789-bdc9-4200f1b6eb07 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:06.341664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a5dbf08-4ddb-4789-bdc9-4200f1b6eb07 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:06.342115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4a5dbf08-4ddb-4789-bdc9-4200f1b6eb07 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:06.404533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4a5dbf08-4ddb-4789-bdc9-4200f1b6eb07 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:06.412500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4a5dbf08-4ddb-4789-bdc9-4200f1b6eb07 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083823 Jun 02 16:40:06.413069 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1045/2329] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:06.503712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:40:06.503881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:40:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:40:07.429701 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e2b61ea7-2023-4bed-a7f3-358528c3e2e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:07.430340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e2b61ea7-2023-4bed-a7f3-358528c3e2e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:07.436788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2b61ea7-2023-4bed-a7f3-358528c3e2e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:07.437240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2b61ea7-2023-4bed-a7f3-358528c3e2e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:07.437991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2b61ea7-2023-4bed-a7f3-358528c3e2e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:07.438453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e2b61ea7-2023-4bed-a7f3-358528c3e2e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:07.498356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e2b61ea7-2023-4bed-a7f3-358528c3e2e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:07.506203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e2b61ea7-2023-4bed-a7f3-358528c3e2e6 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.080355 Jun 02 16:40:07.506759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1285/2330] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:08.522659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fc331d4d-72b2-4cc9-aab1-3970d68dd1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:08.523247 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fc331d4d-72b2-4cc9-aab1-3970d68dd1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:08.529948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc331d4d-72b2-4cc9-aab1-3970d68dd1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:08.530498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc331d4d-72b2-4cc9-aab1-3970d68dd1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:08.531260 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc331d4d-72b2-4cc9-aab1-3970d68dd1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:08.531696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fc331d4d-72b2-4cc9-aab1-3970d68dd1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:08.592872 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fc331d4d-72b2-4cc9-aab1-3970d68dd1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:08.600696 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fc331d4d-72b2-4cc9-aab1-3970d68dd1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081956 Jun 02 16:40:08.601249 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1046/2331] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:08 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:09.618714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-47d306a6-1bb0-4738-98fa-e6d7d1082aa8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:09.619390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-47d306a6-1bb0-4738-98fa-e6d7d1082aa8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:09.625661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47d306a6-1bb0-4738-98fa-e6d7d1082aa8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:09.626131 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47d306a6-1bb0-4738-98fa-e6d7d1082aa8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:09.626886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47d306a6-1bb0-4738-98fa-e6d7d1082aa8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:09.627316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-47d306a6-1bb0-4738-98fa-e6d7d1082aa8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:09.688018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-47d306a6-1bb0-4738-98fa-e6d7d1082aa8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:09.696484 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-47d306a6-1bb0-4738-98fa-e6d7d1082aa8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081594 Jun 02 16:40:09.697126 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1286/2332] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:10.714458 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c0ca3587-cc32-451d-a3cc-badc5b33bc4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:10.715069 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c0ca3587-cc32-451d-a3cc-badc5b33bc4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:10.721538 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0ca3587-cc32-451d-a3cc-badc5b33bc4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:10.721988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0ca3587-cc32-451d-a3cc-badc5b33bc4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:10.723485 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0ca3587-cc32-451d-a3cc-badc5b33bc4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:10.723968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c0ca3587-cc32-451d-a3cc-badc5b33bc4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:10.786263 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c0ca3587-cc32-451d-a3cc-badc5b33bc4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:10.794432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c0ca3587-cc32-451d-a3cc-badc5b33bc4e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084786 Jun 02 16:40:10.794994 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1047/2333] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:10 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:11.811617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4c2ccbb5-21f7-41f2-a075-8c0c3a2028dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:11.812237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4c2ccbb5-21f7-41f2-a075-8c0c3a2028dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:11.818778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c2ccbb5-21f7-41f2-a075-8c0c3a2028dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:11.820556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c2ccbb5-21f7-41f2-a075-8c0c3a2028dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:11.820556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c2ccbb5-21f7-41f2-a075-8c0c3a2028dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:11.820556 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4c2ccbb5-21f7-41f2-a075-8c0c3a2028dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:11.883252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4c2ccbb5-21f7-41f2-a075-8c0c3a2028dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:11.891123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4c2ccbb5-21f7-41f2-a075-8c0c3a2028dc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083372 Jun 02 16:40:11.891675 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1287/2334] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:11 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:12.908616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d363b467-e92f-4df8-a6d3-9143583a5b31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:12.909218 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d363b467-e92f-4df8-a6d3-9143583a5b31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:12.916294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d363b467-e92f-4df8-a6d3-9143583a5b31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:12.916745 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d363b467-e92f-4df8-a6d3-9143583a5b31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:12.917517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d363b467-e92f-4df8-a6d3-9143583a5b31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:12.917962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d363b467-e92f-4df8-a6d3-9143583a5b31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:12.982363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d363b467-e92f-4df8-a6d3-9143583a5b31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:12.990212 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d363b467-e92f-4df8-a6d3-9143583a5b31 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085475 Jun 02 16:40:12.990771 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1048/2335] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:14.007291 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-79947518-4c80-4331-b667-d2d58c39c0cd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:14.007947 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-79947518-4c80-4331-b667-d2d58c39c0cd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:14.014423 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79947518-4c80-4331-b667-d2d58c39c0cd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:14.014868 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79947518-4c80-4331-b667-d2d58c39c0cd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:14.015617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79947518-4c80-4331-b667-d2d58c39c0cd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:14.016052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-79947518-4c80-4331-b667-d2d58c39c0cd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:14.078018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-79947518-4c80-4331-b667-d2d58c39c0cd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:14.086719 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-79947518-4c80-4331-b667-d2d58c39c0cd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082778 Jun 02 16:40:14.087270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1288/2336] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:40:15.103825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3001750f-c1d9-41a8-b9f5-03ad6f747707 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:15.104424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3001750f-c1d9-41a8-b9f5-03ad6f747707 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:15.110539 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3001750f-c1d9-41a8-b9f5-03ad6f747707 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:15.110983 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3001750f-c1d9-41a8-b9f5-03ad6f747707 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:15.111736 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3001750f-c1d9-41a8-b9f5-03ad6f747707 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:15.112165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3001750f-c1d9-41a8-b9f5-03ad6f747707 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:15.172628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-3001750f-c1d9-41a8-b9f5-03ad6f747707 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:15.180570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3001750f-c1d9-41a8-b9f5-03ad6f747707 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.080818 Jun 02 16:40:15.181124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1049/2337] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:15 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:16.198024 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3b4d8321-f0e6-4dd1-b693-b2ae38a73437 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:16.198672 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3b4d8321-f0e6-4dd1-b693-b2ae38a73437 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:16.204703 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b4d8321-f0e6-4dd1-b693-b2ae38a73437 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:16.205158 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b4d8321-f0e6-4dd1-b693-b2ae38a73437 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:16.205921 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b4d8321-f0e6-4dd1-b693-b2ae38a73437 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:16.206391 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3b4d8321-f0e6-4dd1-b693-b2ae38a73437 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:16.267538 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-3b4d8321-f0e6-4dd1-b693-b2ae38a73437 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:16.275530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3b4d8321-f0e6-4dd1-b693-b2ae38a73437 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082365 Jun 02 16:40:16.276095 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1289/2338] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:17.293415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d0b4ea78-88cf-486a-b134-85c86af21e86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:17.294026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d0b4ea78-88cf-486a-b134-85c86af21e86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:17.300561 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d0b4ea78-88cf-486a-b134-85c86af21e86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:17.301018 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d0b4ea78-88cf-486a-b134-85c86af21e86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:17.301789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d0b4ea78-88cf-486a-b134-85c86af21e86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:17.302263 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d0b4ea78-88cf-486a-b134-85c86af21e86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:17.364333 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d0b4ea78-88cf-486a-b134-85c86af21e86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:17.373351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d0b4ea78-88cf-486a-b134-85c86af21e86 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084856 Jun 02 16:40:17.373919 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1050/2339] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:18.391250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-74ee4f97-bfc7-47a4-8410-3b7df02b13c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:18.391802 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-74ee4f97-bfc7-47a4-8410-3b7df02b13c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:18.398810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74ee4f97-bfc7-47a4-8410-3b7df02b13c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:18.399542 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74ee4f97-bfc7-47a4-8410-3b7df02b13c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:18.400393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74ee4f97-bfc7-47a4-8410-3b7df02b13c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:18.400836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74ee4f97-bfc7-47a4-8410-3b7df02b13c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:18.462177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-74ee4f97-bfc7-47a4-8410-3b7df02b13c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:18.470005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-74ee4f97-bfc7-47a4-8410-3b7df02b13c8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082653 Jun 02 16:40:18.470592 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1290/2340] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:19.487681 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f693e2ab-123e-4202-9766-d98c2b416a7b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:19.488306 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f693e2ab-123e-4202-9766-d98c2b416a7b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:19.495730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f693e2ab-123e-4202-9766-d98c2b416a7b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:19.496191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f693e2ab-123e-4202-9766-d98c2b416a7b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:19.496964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f693e2ab-123e-4202-9766-d98c2b416a7b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:19.497408 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f693e2ab-123e-4202-9766-d98c2b416a7b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:19.560456 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f693e2ab-123e-4202-9766-d98c2b416a7b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:19.568400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f693e2ab-123e-4202-9766-d98c2b416a7b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084578 Jun 02 16:40:19.568961 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1051/2341] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:19 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:19.602699 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:40:19.603229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:40:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:40:20.586065 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-13ce9ff5-0b39-4284-aaa2-6856a2e72e62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:20.586641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-13ce9ff5-0b39-4284-aaa2-6856a2e72e62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:20.593182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-13ce9ff5-0b39-4284-aaa2-6856a2e72e62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:20.593622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-13ce9ff5-0b39-4284-aaa2-6856a2e72e62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:20.594401 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-13ce9ff5-0b39-4284-aaa2-6856a2e72e62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:20.594831 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-13ce9ff5-0b39-4284-aaa2-6856a2e72e62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:20.655034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-13ce9ff5-0b39-4284-aaa2-6856a2e72e62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:20.662832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-13ce9ff5-0b39-4284-aaa2-6856a2e72e62 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081012 Jun 02 16:40:20.663386 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1291/2342] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:21.680836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2c7d59cb-57f1-4365-9cbe-8d7e17bc587f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:21.681442 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2c7d59cb-57f1-4365-9cbe-8d7e17bc587f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:21.683806 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:40:21.688500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2c7d59cb-57f1-4365-9cbe-8d7e17bc587f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:21.688946 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2c7d59cb-57f1-4365-9cbe-8d7e17bc587f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:21.689698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2c7d59cb-57f1-4365-9cbe-8d7e17bc587f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:21.690154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2c7d59cb-57f1-4365-9cbe-8d7e17bc587f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:21.759469 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2c7d59cb-57f1-4365-9cbe-8d7e17bc587f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:21.767380 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2c7d59cb-57f1-4365-9cbe-8d7e17bc587f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.090899 Jun 02 16:40:21.767948 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1052/2343] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:21 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:22.784519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-636f14f0-751b-4b07-b5b3-fe80caadc815 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:22.785116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-636f14f0-751b-4b07-b5b3-fe80caadc815 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:22.787480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=28 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:40:22.792691 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-636f14f0-751b-4b07-b5b3-fe80caadc815 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:22.793138 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-636f14f0-751b-4b07-b5b3-fe80caadc815 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:22.793987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-636f14f0-751b-4b07-b5b3-fe80caadc815 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:22.794357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-636f14f0-751b-4b07-b5b3-fe80caadc815 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:22.860296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-636f14f0-751b-4b07-b5b3-fe80caadc815 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:22.869053 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-636f14f0-751b-4b07-b5b3-fe80caadc815 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.088374 Jun 02 16:40:22.869621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1292/2344] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:23.885887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b764365c-bec8-4c12-97a2-c68414b472cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:23.886508 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b764365c-bec8-4c12-97a2-c68414b472cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:23.892933 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b764365c-bec8-4c12-97a2-c68414b472cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:23.893385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b764365c-bec8-4c12-97a2-c68414b472cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:23.894182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b764365c-bec8-4c12-97a2-c68414b472cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:23.894619 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b764365c-bec8-4c12-97a2-c68414b472cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:23.955967 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b764365c-bec8-4c12-97a2-c68414b472cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:23.964767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b764365c-bec8-4c12-97a2-c68414b472cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082833 Jun 02 16:40:23.965326 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1053/2345] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:24.981653 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a7c7b991-a3ce-4561-aa20-13886cebab2f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:24.982286 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a7c7b991-a3ce-4561-aa20-13886cebab2f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:24.988981 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7c7b991-a3ce-4561-aa20-13886cebab2f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:24.989434 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7c7b991-a3ce-4561-aa20-13886cebab2f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:24.990235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7c7b991-a3ce-4561-aa20-13886cebab2f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:24.990684 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a7c7b991-a3ce-4561-aa20-13886cebab2f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:25.051241 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a7c7b991-a3ce-4561-aa20-13886cebab2f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:25.059778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a7c7b991-a3ce-4561-aa20-13886cebab2f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082561 Jun 02 16:40:25.060327 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1293/2346] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:26.076908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-22098b73-21b3-4bc7-a7eb-e11ae4da1949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:26.077499 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-22098b73-21b3-4bc7-a7eb-e11ae4da1949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:26.084747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22098b73-21b3-4bc7-a7eb-e11ae4da1949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:26.085465 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22098b73-21b3-4bc7-a7eb-e11ae4da1949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:26.086257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22098b73-21b3-4bc7-a7eb-e11ae4da1949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:26.086695 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-22098b73-21b3-4bc7-a7eb-e11ae4da1949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:26.089251 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=86 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:40:26.148028 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-22098b73-21b3-4bc7-a7eb-e11ae4da1949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:26.156369 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-22098b73-21b3-4bc7-a7eb-e11ae4da1949 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083698 Jun 02 16:40:26.156930 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1054/2347] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:27.173622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f1b7e13e-4539-4fee-8372-5954028ad1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:27.174018 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f1b7e13e-4539-4fee-8372-5954028ad1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:27.180270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1b7e13e-4539-4fee-8372-5954028ad1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:27.180739 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1b7e13e-4539-4fee-8372-5954028ad1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:27.181491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1b7e13e-4539-4fee-8372-5954028ad1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:27.181948 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f1b7e13e-4539-4fee-8372-5954028ad1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:27.244876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f1b7e13e-4539-4fee-8372-5954028ad1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:27.252753 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f1b7e13e-4539-4fee-8372-5954028ad1d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083360 Jun 02 16:40:27.253312 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1294/2348] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:28.270157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-13407ec3-c2d3-4b49-8083-9d7a63ec141b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:28.270769 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-13407ec3-c2d3-4b49-8083-9d7a63ec141b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:28.277739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13407ec3-c2d3-4b49-8083-9d7a63ec141b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:28.278209 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13407ec3-c2d3-4b49-8083-9d7a63ec141b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:28.278964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13407ec3-c2d3-4b49-8083-9d7a63ec141b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:28.279393 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-13407ec3-c2d3-4b49-8083-9d7a63ec141b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:28.339925 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-13407ec3-c2d3-4b49-8083-9d7a63ec141b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:28.347699 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-13407ec3-c2d3-4b49-8083-9d7a63ec141b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081448 Jun 02 16:40:28.348255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1055/2349] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:29.365123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-678ef17a-56b7-4f3e-a604-fc7e3c1fac7a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:29.365770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-678ef17a-56b7-4f3e-a604-fc7e3c1fac7a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:29.372323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-678ef17a-56b7-4f3e-a604-fc7e3c1fac7a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:29.372778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-678ef17a-56b7-4f3e-a604-fc7e3c1fac7a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:29.373567 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-678ef17a-56b7-4f3e-a604-fc7e3c1fac7a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:29.374005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-678ef17a-56b7-4f3e-a604-fc7e3c1fac7a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:29.435145 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-678ef17a-56b7-4f3e-a604-fc7e3c1fac7a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:29.442938 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-678ef17a-56b7-4f3e-a604-fc7e3c1fac7a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081753 Jun 02 16:40:29.443492 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1295/2350] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:30.460758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e8cb92d5-d863-4e23-8286-774cc7b18b2d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:30.461324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e8cb92d5-d863-4e23-8286-774cc7b18b2d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:30.468244 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e8cb92d5-d863-4e23-8286-774cc7b18b2d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:30.468690 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e8cb92d5-d863-4e23-8286-774cc7b18b2d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:30.469444 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e8cb92d5-d863-4e23-8286-774cc7b18b2d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:30.469878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e8cb92d5-d863-4e23-8286-774cc7b18b2d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:30.533026 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e8cb92d5-d863-4e23-8286-774cc7b18b2d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:30.541161 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e8cb92d5-d863-4e23-8286-774cc7b18b2d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084625 Jun 02 16:40:30.541733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1056/2351] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:31.559896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2dc07198-833c-40fd-ae51-dba3b7bca49d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:31.560515 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2dc07198-833c-40fd-ae51-dba3b7bca49d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:31.566999 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2dc07198-833c-40fd-ae51-dba3b7bca49d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:31.567453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2dc07198-833c-40fd-ae51-dba3b7bca49d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:31.568218 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2dc07198-833c-40fd-ae51-dba3b7bca49d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:31.568660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2dc07198-833c-40fd-ae51-dba3b7bca49d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:31.632476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2dc07198-833c-40fd-ae51-dba3b7bca49d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:31.640661 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2dc07198-833c-40fd-ae51-dba3b7bca49d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085647 Jun 02 16:40:31.641230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1296/2352] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:31 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:32.656871 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0e5d0ed4-68bb-4fb7-ae9f-8d66a7f7dce3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:32.657434 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0e5d0ed4-68bb-4fb7-ae9f-8d66a7f7dce3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:32.663799 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ed4-68bb-4fb7-ae9f-8d66a7f7dce3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:32.664246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ed4-68bb-4fb7-ae9f-8d66a7f7dce3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:32.664997 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ed4-68bb-4fb7-ae9f-8d66a7f7dce3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:32.665436 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0e5d0ed4-68bb-4fb7-ae9f-8d66a7f7dce3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:32.726726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0e5d0ed4-68bb-4fb7-ae9f-8d66a7f7dce3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:32.734517 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0e5d0ed4-68bb-4fb7-ae9f-8d66a7f7dce3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081581 Jun 02 16:40:32.735082 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1057/2353] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:32 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:33.751443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-402995f9-ebfd-4df6-9be6-e0f785edc410 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:33.752036 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-402995f9-ebfd-4df6-9be6-e0f785edc410 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:33.758479 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-402995f9-ebfd-4df6-9be6-e0f785edc410 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:33.758931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-402995f9-ebfd-4df6-9be6-e0f785edc410 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:33.759690 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-402995f9-ebfd-4df6-9be6-e0f785edc410 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:33.760122 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-402995f9-ebfd-4df6-9be6-e0f785edc410 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:33.820499 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-402995f9-ebfd-4df6-9be6-e0f785edc410 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:33.829250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-402995f9-ebfd-4df6-9be6-e0f785edc410 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081703 Jun 02 16:40:33.829820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1297/2354] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:34.846615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-72b6845b-981f-4df4-8d19-c7363aad6f46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:34.847231 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-72b6845b-981f-4df4-8d19-c7363aad6f46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:34.853685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72b6845b-981f-4df4-8d19-c7363aad6f46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:34.854133 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72b6845b-981f-4df4-8d19-c7363aad6f46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:34.854971 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72b6845b-981f-4df4-8d19-c7363aad6f46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:34.855406 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-72b6845b-981f-4df4-8d19-c7363aad6f46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:34.917314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-72b6845b-981f-4df4-8d19-c7363aad6f46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:34.925129 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-72b6845b-981f-4df4-8d19-c7363aad6f46 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082309 Jun 02 16:40:34.925679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1058/2355] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:35.942830 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c0f61150-b3ba-42c7-833f-5b69990a0508 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:35.943462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c0f61150-b3ba-42c7-833f-5b69990a0508 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:35.950541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0f61150-b3ba-42c7-833f-5b69990a0508 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:35.950985 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0f61150-b3ba-42c7-833f-5b69990a0508 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:35.951730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0f61150-b3ba-42c7-833f-5b69990a0508 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:35.952160 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c0f61150-b3ba-42c7-833f-5b69990a0508 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:35.954731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:40:36.014714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c0f61150-b3ba-42c7-833f-5b69990a0508 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:36.022493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c0f61150-b3ba-42c7-833f-5b69990a0508 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083555 Jun 02 16:40:36.023069 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1298/2356] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:35 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:37.040756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c8f25bec-d9dc-4592-8e5a-67b305483524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:37.041356 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c8f25bec-d9dc-4592-8e5a-67b305483524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:37.048579 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8f25bec-d9dc-4592-8e5a-67b305483524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:37.049032 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8f25bec-d9dc-4592-8e5a-67b305483524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:37.054111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8f25bec-d9dc-4592-8e5a-67b305483524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:37.054111 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8f25bec-d9dc-4592-8e5a-67b305483524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:37.113032 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c8f25bec-d9dc-4592-8e5a-67b305483524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:37.121064 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c8f25bec-d9dc-4592-8e5a-67b305483524 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084181 Jun 02 16:40:37.121617 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1059/2357] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:37 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:38.139682 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-74c9ddf5-27c3-4e5d-aa51-297483036c4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:38.140232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-74c9ddf5-27c3-4e5d-aa51-297483036c4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:38.146744 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74c9ddf5-27c3-4e5d-aa51-297483036c4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:38.147202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74c9ddf5-27c3-4e5d-aa51-297483036c4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:38.147965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74c9ddf5-27c3-4e5d-aa51-297483036c4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:38.148396 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74c9ddf5-27c3-4e5d-aa51-297483036c4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:38.211818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-74c9ddf5-27c3-4e5d-aa51-297483036c4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:38.220583 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-74c9ddf5-27c3-4e5d-aa51-297483036c4b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085744 Jun 02 16:40:38.221147 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1299/2358] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:38 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:39.237716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-43a682de-6139-4bef-b67c-7d9d0ad14d72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:39.238348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-43a682de-6139-4bef-b67c-7d9d0ad14d72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:39.245391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43a682de-6139-4bef-b67c-7d9d0ad14d72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:39.245834 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43a682de-6139-4bef-b67c-7d9d0ad14d72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:39.246621 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43a682de-6139-4bef-b67c-7d9d0ad14d72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:39.247055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-43a682de-6139-4bef-b67c-7d9d0ad14d72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:39.310044 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-43a682de-6139-4bef-b67c-7d9d0ad14d72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:39.317864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-43a682de-6139-4bef-b67c-7d9d0ad14d72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083935 Jun 02 16:40:39.318457 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1060/2359] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:40.334495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c91e89b5-bf9b-4573-bedf-0107fb60a33e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:40.335488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c91e89b5-bf9b-4573-bedf-0107fb60a33e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:40.342141 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c91e89b5-bf9b-4573-bedf-0107fb60a33e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:40.349156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c91e89b5-bf9b-4573-bedf-0107fb60a33e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:40.349156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c91e89b5-bf9b-4573-bedf-0107fb60a33e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:40.349156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c91e89b5-bf9b-4573-bedf-0107fb60a33e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:40.407956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c91e89b5-bf9b-4573-bedf-0107fb60a33e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:40.415886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c91e89b5-bf9b-4573-bedf-0107fb60a33e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085392 Jun 02 16:40:40.416726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1300/2360] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:41.432626 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c8cb3628-beaa-4237-a26b-98aa17d714e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:41.433243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c8cb3628-beaa-4237-a26b-98aa17d714e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:41.439850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8cb3628-beaa-4237-a26b-98aa17d714e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:41.440309 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8cb3628-beaa-4237-a26b-98aa17d714e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:41.441074 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8cb3628-beaa-4237-a26b-98aa17d714e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:41.441521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c8cb3628-beaa-4237-a26b-98aa17d714e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:41.502463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-c8cb3628-beaa-4237-a26b-98aa17d714e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:41.510229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c8cb3628-beaa-4237-a26b-98aa17d714e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081433 Jun 02 16:40:41.511322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1061/2361] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:42.527977 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c69800d3-7b78-4413-ae10-e95296cdf439 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:42.528520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c69800d3-7b78-4413-ae10-e95296cdf439 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:42.534881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c69800d3-7b78-4413-ae10-e95296cdf439 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:42.535326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c69800d3-7b78-4413-ae10-e95296cdf439 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:42.536071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c69800d3-7b78-4413-ae10-e95296cdf439 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:42.536501 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c69800d3-7b78-4413-ae10-e95296cdf439 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:42.598551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c69800d3-7b78-4413-ae10-e95296cdf439 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:42.606927 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c69800d3-7b78-4413-ae10-e95296cdf439 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083333 Jun 02 16:40:42.607486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1301/2362] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:43.624116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9f27d4be-e723-4e42-8f8a-78b480e07b66 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:43.624770 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9f27d4be-e723-4e42-8f8a-78b480e07b66 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:43.631238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f27d4be-e723-4e42-8f8a-78b480e07b66 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:43.631689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f27d4be-e723-4e42-8f8a-78b480e07b66 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:43.632454 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f27d4be-e723-4e42-8f8a-78b480e07b66 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:43.632894 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9f27d4be-e723-4e42-8f8a-78b480e07b66 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:43.697373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9f27d4be-e723-4e42-8f8a-78b480e07b66 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:43.705867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9f27d4be-e723-4e42-8f8a-78b480e07b66 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085970 Jun 02 16:40:43.706450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1062/2363] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:43 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:44.723736 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9e71f9a9-3c10-459a-81ad-09cd2b3d26e8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:44.724344 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9e71f9a9-3c10-459a-81ad-09cd2b3d26e8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:44.731735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e71f9a9-3c10-459a-81ad-09cd2b3d26e8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:44.732186 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e71f9a9-3c10-459a-81ad-09cd2b3d26e8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:44.732949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e71f9a9-3c10-459a-81ad-09cd2b3d26e8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:44.733389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e71f9a9-3c10-459a-81ad-09cd2b3d26e8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:44.794948 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9e71f9a9-3c10-459a-81ad-09cd2b3d26e8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:44.802757 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9e71f9a9-3c10-459a-81ad-09cd2b3d26e8 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082952 Jun 02 16:40:44.803316 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1302/2364] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:44 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:45.819874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f749b74b-1e86-4aac-95bd-e8f6153955b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:45.820590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f749b74b-1e86-4aac-95bd-e8f6153955b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:45.827104 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f749b74b-1e86-4aac-95bd-e8f6153955b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:45.827605 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f749b74b-1e86-4aac-95bd-e8f6153955b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:45.828353 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f749b74b-1e86-4aac-95bd-e8f6153955b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:45.828785 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f749b74b-1e86-4aac-95bd-e8f6153955b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:45.889548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f749b74b-1e86-4aac-95bd-e8f6153955b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:45.897397 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f749b74b-1e86-4aac-95bd-e8f6153955b1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081332 Jun 02 16:40:45.897940 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1063/2365] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:45 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:46.915011 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f2f215ac-dc9a-47fb-9285-90a98034639f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:46.915620 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f2f215ac-dc9a-47fb-9285-90a98034639f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:46.922909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2f215ac-dc9a-47fb-9285-90a98034639f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:46.923361 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2f215ac-dc9a-47fb-9285-90a98034639f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:46.924116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2f215ac-dc9a-47fb-9285-90a98034639f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:46.924552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f2f215ac-dc9a-47fb-9285-90a98034639f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:46.984686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f2f215ac-dc9a-47fb-9285-90a98034639f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:46.992520 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f2f215ac-dc9a-47fb-9285-90a98034639f tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081417 Jun 02 16:40:46.993089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1303/2366] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:46 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:48.008897 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ca515c89-3a8b-4a9b-bec7-72ddbce7c154 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:48.009507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ca515c89-3a8b-4a9b-bec7-72ddbce7c154 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:48.016500 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ca515c89-3a8b-4a9b-bec7-72ddbce7c154 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:48.016942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ca515c89-3a8b-4a9b-bec7-72ddbce7c154 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:48.017732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ca515c89-3a8b-4a9b-bec7-72ddbce7c154 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:48.018187 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ca515c89-3a8b-4a9b-bec7-72ddbce7c154 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:48.110406 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ca515c89-3a8b-4a9b-bec7-72ddbce7c154 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:48.118318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ca515c89-3a8b-4a9b-bec7-72ddbce7c154 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.113250 Jun 02 16:40:48.118893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1064/2367] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:48 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:49.135415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0bee2427-f5aa-47bd-a5de-484bc19cee06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:49.136101 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0bee2427-f5aa-47bd-a5de-484bc19cee06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:49.142589 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0bee2427-f5aa-47bd-a5de-484bc19cee06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:49.143040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0bee2427-f5aa-47bd-a5de-484bc19cee06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:49.143805 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0bee2427-f5aa-47bd-a5de-484bc19cee06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:49.144246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0bee2427-f5aa-47bd-a5de-484bc19cee06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:49.208869 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0bee2427-f5aa-47bd-a5de-484bc19cee06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:49.217933 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0bee2427-f5aa-47bd-a5de-484bc19cee06 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086355 Jun 02 16:40:49.218541 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1304/2368] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:49 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:50.240066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e1c63176-d8dd-4dcc-ba02-11f6e56f6f18 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:50.240886 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e1c63176-d8dd-4dcc-ba02-11f6e56f6f18 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:50.248291 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e1c63176-d8dd-4dcc-ba02-11f6e56f6f18 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:50.248747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e1c63176-d8dd-4dcc-ba02-11f6e56f6f18 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:50.249523 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e1c63176-d8dd-4dcc-ba02-11f6e56f6f18 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:50.250042 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e1c63176-d8dd-4dcc-ba02-11f6e56f6f18 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:50.317252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e1c63176-d8dd-4dcc-ba02-11f6e56f6f18 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:50.325693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e1c63176-d8dd-4dcc-ba02-11f6e56f6f18 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.089482 Jun 02 16:40:50.326292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1065/2369] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:50 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:51.343530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-939f0aaf-b778-4894-aefe-02bcb748ae88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:51.344143 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-939f0aaf-b778-4894-aefe-02bcb748ae88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:51.350597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-939f0aaf-b778-4894-aefe-02bcb748ae88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:51.351072 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-939f0aaf-b778-4894-aefe-02bcb748ae88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:51.351829 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-939f0aaf-b778-4894-aefe-02bcb748ae88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:51.352265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-939f0aaf-b778-4894-aefe-02bcb748ae88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:51.412997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-939f0aaf-b778-4894-aefe-02bcb748ae88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:51.421381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-939f0aaf-b778-4894-aefe-02bcb748ae88 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082319 Jun 02 16:40:51.421939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1305/2370] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:51 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:52.438590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8dd53514-a2f4-43e5-aeef-1da045fd4451 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:52.439143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8dd53514-a2f4-43e5-aeef-1da045fd4451 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:52.441459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:40:52.446165 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8dd53514-a2f4-43e5-aeef-1da045fd4451 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:52.446613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8dd53514-a2f4-43e5-aeef-1da045fd4451 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:52.447363 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8dd53514-a2f4-43e5-aeef-1da045fd4451 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:52.447793 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8dd53514-a2f4-43e5-aeef-1da045fd4451 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:52.508919 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8dd53514-a2f4-43e5-aeef-1da045fd4451 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:52.516791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8dd53514-a2f4-43e5-aeef-1da045fd4451 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082127 Jun 02 16:40:52.517348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1066/2371] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:52 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:53.533593 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2bf8dc4e-6f43-48d3-aa75-db5dd08ea716 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:53.534239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2bf8dc4e-6f43-48d3-aa75-db5dd08ea716 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:53.536532 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=28 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:40:53.541277 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2bf8dc4e-6f43-48d3-aa75-db5dd08ea716 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:53.541729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2bf8dc4e-6f43-48d3-aa75-db5dd08ea716 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:53.542519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2bf8dc4e-6f43-48d3-aa75-db5dd08ea716 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:53.542959 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2bf8dc4e-6f43-48d3-aa75-db5dd08ea716 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:53.604559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2bf8dc4e-6f43-48d3-aa75-db5dd08ea716 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:53.612668 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2bf8dc4e-6f43-48d3-aa75-db5dd08ea716 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082929 Jun 02 16:40:53.613235 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1306/2372] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:53 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:54.630233 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-39035e89-dc22-4ef1-b16a-219d4cb4589c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:54.630849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-39035e89-dc22-4ef1-b16a-219d4cb4589c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:54.637532 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-39035e89-dc22-4ef1-b16a-219d4cb4589c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:54.637988 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-39035e89-dc22-4ef1-b16a-219d4cb4589c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:54.638775 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-39035e89-dc22-4ef1-b16a-219d4cb4589c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:54.639215 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-39035e89-dc22-4ef1-b16a-219d4cb4589c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:54.700665 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-39035e89-dc22-4ef1-b16a-219d4cb4589c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:54.708613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-39035e89-dc22-4ef1-b16a-219d4cb4589c tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082304 Jun 02 16:40:54.709170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1067/2373] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:54 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:55.727278 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4e4aa6cd-c058-4734-9a42-7431d1d15971 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:55.727890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4e4aa6cd-c058-4734-9a42-7431d1d15971 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:55.734913 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e4aa6cd-c058-4734-9a42-7431d1d15971 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:55.735367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e4aa6cd-c058-4734-9a42-7431d1d15971 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:55.736120 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e4aa6cd-c058-4734-9a42-7431d1d15971 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:55.736557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4e4aa6cd-c058-4734-9a42-7431d1d15971 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:55.800436 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4e4aa6cd-c058-4734-9a42-7431d1d15971 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:55.806642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4e4aa6cd-c058-4734-9a42-7431d1d15971 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083254 Jun 02 16:40:55.807201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1307/2374] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:55 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:56.823417 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-464133b9-9f2a-4a76-bf46-ea42b2906ec7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:56.825047 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-464133b9-9f2a-4a76-bf46-ea42b2906ec7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:56.831145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-464133b9-9f2a-4a76-bf46-ea42b2906ec7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:56.831603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-464133b9-9f2a-4a76-bf46-ea42b2906ec7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:56.832373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-464133b9-9f2a-4a76-bf46-ea42b2906ec7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:56.832812 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-464133b9-9f2a-4a76-bf46-ea42b2906ec7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:56.835611 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=84 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:40:56.898962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-464133b9-9f2a-4a76-bf46-ea42b2906ec7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:56.907361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-464133b9-9f2a-4a76-bf46-ea42b2906ec7 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087882 Jun 02 16:40:56.907927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1068/2375] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:56 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:57.924543 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2280a984-bf40-4836-a0cd-f0c7e19efcba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:57.925149 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2280a984-bf40-4836-a0cd-f0c7e19efcba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:57.931674 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2280a984-bf40-4836-a0cd-f0c7e19efcba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:57.932117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2280a984-bf40-4836-a0cd-f0c7e19efcba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:57.932864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2280a984-bf40-4836-a0cd-f0c7e19efcba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:57.933893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2280a984-bf40-4836-a0cd-f0c7e19efcba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:57.999159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2280a984-bf40-4836-a0cd-f0c7e19efcba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:58.007049 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2280a984-bf40-4836-a0cd-f0c7e19efcba tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086321 Jun 02 16:40:58.007616 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1308/2376] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:57 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:40:59.024278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d67ee899-c6c7-4a11-bf36-5821df446728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:40:59.024957 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d67ee899-c6c7-4a11-bf36-5821df446728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:40:59.031404 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d67ee899-c6c7-4a11-bf36-5821df446728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:59.031846 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d67ee899-c6c7-4a11-bf36-5821df446728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:59.032596 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d67ee899-c6c7-4a11-bf36-5821df446728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:40:59.033027 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d67ee899-c6c7-4a11-bf36-5821df446728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:40:59.094867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d67ee899-c6c7-4a11-bf36-5821df446728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:40:59.102752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d67ee899-c6c7-4a11-bf36-5821df446728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082293 Jun 02 16:40:59.103314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1069/2377] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:40:59 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:00.119463 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b29b537c-cd9b-4193-b799-b20821de3edb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:00.120069 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b29b537c-cd9b-4193-b799-b20821de3edb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:00.126650 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b29b537c-cd9b-4193-b799-b20821de3edb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:00.127093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b29b537c-cd9b-4193-b799-b20821de3edb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:00.127838 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b29b537c-cd9b-4193-b799-b20821de3edb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:00.128267 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b29b537c-cd9b-4193-b799-b20821de3edb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:00.188991 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-b29b537c-cd9b-4193-b799-b20821de3edb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:00.196983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b29b537c-cd9b-4193-b799-b20821de3edb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081309 Jun 02 16:41:00.197545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1309/2378] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:00 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:01.214816 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-876e5f82-36b8-4c2f-89c7-5d8f731b311b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:01.215489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-876e5f82-36b8-4c2f-89c7-5d8f731b311b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:01.221957 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-876e5f82-36b8-4c2f-89c7-5d8f731b311b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:01.222445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-876e5f82-36b8-4c2f-89c7-5d8f731b311b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:01.223217 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-876e5f82-36b8-4c2f-89c7-5d8f731b311b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:01.223655 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-876e5f82-36b8-4c2f-89c7-5d8f731b311b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:01.284702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-876e5f82-36b8-4c2f-89c7-5d8f731b311b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:01.292599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-876e5f82-36b8-4c2f-89c7-5d8f731b311b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082218 Jun 02 16:41:01.293253 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1070/2379] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:01 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:02.309844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1c2bfc53-65d0-4892-a39a-114d35a6fd08 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:02.310488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1c2bfc53-65d0-4892-a39a-114d35a6fd08 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:02.317014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1c2bfc53-65d0-4892-a39a-114d35a6fd08 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:02.317466 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1c2bfc53-65d0-4892-a39a-114d35a6fd08 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:02.318264 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1c2bfc53-65d0-4892-a39a-114d35a6fd08 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:02.318706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1c2bfc53-65d0-4892-a39a-114d35a6fd08 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:02.380292 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1c2bfc53-65d0-4892-a39a-114d35a6fd08 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:02.389169 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1c2bfc53-65d0-4892-a39a-114d35a6fd08 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.083479 Jun 02 16:41:02.389730 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1310/2380] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:02 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:03.406402 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d972b698-bfb3-424b-b5d1-6464b518cb34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:03.407049 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d972b698-bfb3-424b-b5d1-6464b518cb34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:03.413878 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d972b698-bfb3-424b-b5d1-6464b518cb34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:03.414362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d972b698-bfb3-424b-b5d1-6464b518cb34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:03.415123 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d972b698-bfb3-424b-b5d1-6464b518cb34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:03.415559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d972b698-bfb3-424b-b5d1-6464b518cb34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:03.485481 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d972b698-bfb3-424b-b5d1-6464b518cb34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:03.493540 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d972b698-bfb3-424b-b5d1-6464b518cb34 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.091496 Jun 02 16:41:03.494134 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1071/2381] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:03 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:04.510525 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-37b6b06d-b804-4e11-900e-646a232a7bf1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:04.511081 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-37b6b06d-b804-4e11-900e-646a232a7bf1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:04.518124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37b6b06d-b804-4e11-900e-646a232a7bf1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:04.518584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37b6b06d-b804-4e11-900e-646a232a7bf1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:04.519347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37b6b06d-b804-4e11-900e-646a232a7bf1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:04.519784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-37b6b06d-b804-4e11-900e-646a232a7bf1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:04.580273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-37b6b06d-b804-4e11-900e-646a232a7bf1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:04.588375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-37b6b06d-b804-4e11-900e-646a232a7bf1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081918 Jun 02 16:41:04.588931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1311/2382] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:04 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:05.606628 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f194246d-f55b-4534-baaa-762ed2abb9e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:05.607218 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f194246d-f55b-4534-baaa-762ed2abb9e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:05.613671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f194246d-f55b-4534-baaa-762ed2abb9e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:05.614145 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f194246d-f55b-4534-baaa-762ed2abb9e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:05.614906 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f194246d-f55b-4534-baaa-762ed2abb9e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:05.615343 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f194246d-f55b-4534-baaa-762ed2abb9e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:05.679511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f194246d-f55b-4534-baaa-762ed2abb9e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:05.687554 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f194246d-f55b-4534-baaa-762ed2abb9e0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085523 Jun 02 16:41:05.688110 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1072/2383] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:05 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:06.704954 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2669559c-9710-4a20-9946-596faffc31f0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:06.705566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2669559c-9710-4a20-9946-596faffc31f0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:06.712323 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2669559c-9710-4a20-9946-596faffc31f0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:06.712772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2669559c-9710-4a20-9946-596faffc31f0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:06.713529 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2669559c-9710-4a20-9946-596faffc31f0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:06.713970 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2669559c-9710-4a20-9946-596faffc31f0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:06.717410 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:41:06.779573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2669559c-9710-4a20-9946-596faffc31f0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:06.787554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2669559c-9710-4a20-9946-596faffc31f0 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086444 Jun 02 16:41:06.788110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1312/2384] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:06 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:07.804489 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f70959df-55a8-4839-b680-17cfb0f6019a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:07.805078 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f70959df-55a8-4839-b680-17cfb0f6019a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:07.811519 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f70959df-55a8-4839-b680-17cfb0f6019a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:07.811968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f70959df-55a8-4839-b680-17cfb0f6019a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:07.812728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f70959df-55a8-4839-b680-17cfb0f6019a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:07.813182 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f70959df-55a8-4839-b680-17cfb0f6019a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:07.874127 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f70959df-55a8-4839-b680-17cfb0f6019a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:07.881888 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f70959df-55a8-4839-b680-17cfb0f6019a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081264 Jun 02 16:41:07.882478 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1073/2385] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:07 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:08.898877 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8dd741d7-3316-4218-b5fa-2217096641e3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:08.899511 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8dd741d7-3316-4218-b5fa-2217096641e3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:08.906622 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8dd741d7-3316-4218-b5fa-2217096641e3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:08.907071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8dd741d7-3316-4218-b5fa-2217096641e3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:08.907816 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8dd741d7-3316-4218-b5fa-2217096641e3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:08.908247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8dd741d7-3316-4218-b5fa-2217096641e3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:08.969244 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8dd741d7-3316-4218-b5fa-2217096641e3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:08.977041 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8dd741d7-3316-4218-b5fa-2217096641e3 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082012 Jun 02 16:41:08.977595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1313/2386] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:08 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:09.993568 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-11848487-ed2c-4f39-ad2c-67fbac900f1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:09.994277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-11848487-ed2c-4f39-ad2c-67fbac900f1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:10.001495 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11848487-ed2c-4f39-ad2c-67fbac900f1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:10.001942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11848487-ed2c-4f39-ad2c-67fbac900f1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:10.002733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11848487-ed2c-4f39-ad2c-67fbac900f1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:10.003176 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-11848487-ed2c-4f39-ad2c-67fbac900f1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:10.065318 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-11848487-ed2c-4f39-ad2c-67fbac900f1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:10.073546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-11848487-ed2c-4f39-ad2c-67fbac900f1b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084166 Jun 02 16:41:10.074124 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1074/2387] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:09 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:11.090733 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cdfdc204-8228-458b-a9c0-c06549bce33b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:11.091381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cdfdc204-8228-458b-a9c0-c06549bce33b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:11.098247 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cdfdc204-8228-458b-a9c0-c06549bce33b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:11.098705 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cdfdc204-8228-458b-a9c0-c06549bce33b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:11.099471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cdfdc204-8228-458b-a9c0-c06549bce33b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:11.099912 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cdfdc204-8228-458b-a9c0-c06549bce33b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:11.162939 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-cdfdc204-8228-458b-a9c0-c06549bce33b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:11.171788 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cdfdc204-8228-458b-a9c0-c06549bce33b tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085058 Jun 02 16:41:11.172353 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1314/2388] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:11 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:12.189213 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0bd8dd4b-26e7-4fde-a252-7eb697cfb4cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:12.189829 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0bd8dd4b-26e7-4fde-a252-7eb697cfb4cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:12.196376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd8dd4b-26e7-4fde-a252-7eb697cfb4cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:12.196825 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd8dd4b-26e7-4fde-a252-7eb697cfb4cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:12.197593 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd8dd4b-26e7-4fde-a252-7eb697cfb4cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:12.198031 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bd8dd4b-26e7-4fde-a252-7eb697cfb4cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:12.259025 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-0bd8dd4b-26e7-4fde-a252-7eb697cfb4cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:12.267003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0bd8dd4b-26e7-4fde-a252-7eb697cfb4cb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082248 Jun 02 16:41:12.267560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1075/2389] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:12 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:13.283673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-05706cb6-6e95-4b92-8578-ea198b7ebedd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:13.284282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-05706cb6-6e95-4b92-8578-ea198b7ebedd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:13.290740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-05706cb6-6e95-4b92-8578-ea198b7ebedd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:13.291193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-05706cb6-6e95-4b92-8578-ea198b7ebedd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:13.291956 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-05706cb6-6e95-4b92-8578-ea198b7ebedd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:13.292394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-05706cb6-6e95-4b92-8578-ea198b7ebedd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:13.352777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-05706cb6-6e95-4b92-8578-ea198b7ebedd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:13.361385 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-05706cb6-6e95-4b92-8578-ea198b7ebedd tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082286 Jun 02 16:41:13.361946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1315/2390] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:13 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:41:14.379297 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-eccc1cef-6a0a-47ef-b225-3775012ea728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:14.379911 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-eccc1cef-6a0a-47ef-b225-3775012ea728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:14.386516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eccc1cef-6a0a-47ef-b225-3775012ea728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:14.386962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eccc1cef-6a0a-47ef-b225-3775012ea728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:14.387742 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eccc1cef-6a0a-47ef-b225-3775012ea728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:14.388175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-eccc1cef-6a0a-47ef-b225-3775012ea728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:14.453266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-eccc1cef-6a0a-47ef-b225-3775012ea728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:14.461143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-eccc1cef-6a0a-47ef-b225-3775012ea728 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.085704 Jun 02 16:41:14.461704 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1076/2391] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:14 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:15.478689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9e33ab85-1b3b-4b4f-80d7-264fe16e2a89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:15.479295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9e33ab85-1b3b-4b4f-80d7-264fe16e2a89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:15.486411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e33ab85-1b3b-4b4f-80d7-264fe16e2a89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:15.486867 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e33ab85-1b3b-4b4f-80d7-264fe16e2a89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:15.487644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e33ab85-1b3b-4b4f-80d7-264fe16e2a89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:15.488091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9e33ab85-1b3b-4b4f-80d7-264fe16e2a89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:15.556561 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9e33ab85-1b3b-4b4f-80d7-264fe16e2a89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:15.565043 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9e33ab85-1b3b-4b4f-80d7-264fe16e2a89 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.090507 Jun 02 16:41:15.565599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1316/2392] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:15 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:16.582167 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b9dd73f2-4cc0-48bb-b336-535f080631fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:16.582759 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b9dd73f2-4cc0-48bb-b336-535f080631fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:16.589301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b9dd73f2-4cc0-48bb-b336-535f080631fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:16.589757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b9dd73f2-4cc0-48bb-b336-535f080631fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:16.590549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b9dd73f2-4cc0-48bb-b336-535f080631fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:16.590991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b9dd73f2-4cc0-48bb-b336-535f080631fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:16.652527 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b9dd73f2-4cc0-48bb-b336-535f080631fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:16.660956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b9dd73f2-4cc0-48bb-b336-535f080631fb tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082820 Jun 02 16:41:16.661548 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1077/2393] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:16 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:17.678476 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-06fef665-88f7-4243-bd2a-d72c7831d419 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:17.679074 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-06fef665-88f7-4243-bd2a-d72c7831d419 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:17.685389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06fef665-88f7-4243-bd2a-d72c7831d419 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:17.685881 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06fef665-88f7-4243-bd2a-d72c7831d419 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:17.686667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06fef665-88f7-4243-bd2a-d72c7831d419 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:17.687093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-06fef665-88f7-4243-bd2a-d72c7831d419 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:17.747559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-06fef665-88f7-4243-bd2a-d72c7831d419 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:17.755807 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-06fef665-88f7-4243-bd2a-d72c7831d419 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081159 Jun 02 16:41:17.756367 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1317/2394] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:17 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:41:18.772791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9611d6f9-ebc9-4a08-ae06-34f69fcd8d8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:18.773432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9611d6f9-ebc9-4a08-ae06-34f69fcd8d8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:18.780939 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9611d6f9-ebc9-4a08-ae06-34f69fcd8d8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:18.781382 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9611d6f9-ebc9-4a08-ae06-34f69fcd8d8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:18.782169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9611d6f9-ebc9-4a08-ae06-34f69fcd8d8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:18.782610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9611d6f9-ebc9-4a08-ae06-34f69fcd8d8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:18.847057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9611d6f9-ebc9-4a08-ae06-34f69fcd8d8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:18.855010 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9611d6f9-ebc9-4a08-ae06-34f69fcd8d8d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086181 Jun 02 16:41:18.855567 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1078/2395] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:18 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:19.872447 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fa710679-d0b1-42b3-a6f7-ad74d4d29e0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:19.873117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fa710679-d0b1-42b3-a6f7-ad74d4d29e0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:19.880249 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa710679-d0b1-42b3-a6f7-ad74d4d29e0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:19.880695 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa710679-d0b1-42b3-a6f7-ad74d4d29e0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:19.881453 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa710679-d0b1-42b3-a6f7-ad74d4d29e0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:19.881888 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fa710679-d0b1-42b3-a6f7-ad74d4d29e0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:19.943270 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fa710679-d0b1-42b3-a6f7-ad74d4d29e0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:19.951144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fa710679-d0b1-42b3-a6f7-ad74d4d29e0d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082666 Jun 02 16:41:19.952302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1318/2396] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:19 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:20.970067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7d66b19e-8bef-4a0e-a93a-a4369fc9d7e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:20.970700 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-7d66b19e-8bef-4a0e-a93a-a4369fc9d7e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:20.977240 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d66b19e-8bef-4a0e-a93a-a4369fc9d7e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:20.977692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d66b19e-8bef-4a0e-a93a-a4369fc9d7e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:20.978507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d66b19e-8bef-4a0e-a93a-a4369fc9d7e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:20.978950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-7d66b19e-8bef-4a0e-a93a-a4369fc9d7e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:21.040360 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-7d66b19e-8bef-4a0e-a93a-a4369fc9d7e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:21.049197 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7d66b19e-8bef-4a0e-a93a-a4369fc9d7e9 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084028 Jun 02 16:41:21.049766 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1079/2397] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:20 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:22.066091 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-886931ca-df04-4191-8848-0c59258b0af1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:22.066711 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-886931ca-df04-4191-8848-0c59258b0af1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:22.073182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-886931ca-df04-4191-8848-0c59258b0af1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:22.073635 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-886931ca-df04-4191-8848-0c59258b0af1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:22.074433 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-886931ca-df04-4191-8848-0c59258b0af1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:22.074875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-886931ca-df04-4191-8848-0c59258b0af1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:22.135122 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-886931ca-df04-4191-8848-0c59258b0af1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:22.143116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-886931ca-df04-4191-8848-0c59258b0af1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.080924 Jun 02 16:41:22.143686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1319/2398] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:22 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:23.160152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-41b47363-0fc1-488c-9738-c324775834aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:23.160702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-41b47363-0fc1-488c-9738-c324775834aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:23.162947 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=28 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:41:23.168215 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41b47363-0fc1-488c-9738-c324775834aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:23.168739 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41b47363-0fc1-488c-9738-c324775834aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:23.171238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41b47363-0fc1-488c-9738-c324775834aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:23.171238 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-41b47363-0fc1-488c-9738-c324775834aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:23.236216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-41b47363-0fc1-488c-9738-c324775834aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:23.244155 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-41b47363-0fc1-488c-9738-c324775834aa tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087861 Jun 02 16:41:23.244717 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1080/2399] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:23 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:24.261756 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7a224bab-e713-4438-955c-89d3fae6791d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:24.262393 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7a224bab-e713-4438-955c-89d3fae6791d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:24.265706 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=28 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:41:24.270495 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a224bab-e713-4438-955c-89d3fae6791d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:24.270949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a224bab-e713-4438-955c-89d3fae6791d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:24.271712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a224bab-e713-4438-955c-89d3fae6791d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:24.272151 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-7a224bab-e713-4438-955c-89d3fae6791d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:24.337489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7a224bab-e713-4438-955c-89d3fae6791d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:24.346174 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7a224bab-e713-4438-955c-89d3fae6791d tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.088265 Jun 02 16:41:24.346740 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1320/2400] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:24 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:25.363953 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fa557105-5d5a-46e1-a3c0-1d0252daaa61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:25.364577 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fa557105-5d5a-46e1-a3c0-1d0252daaa61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:25.371261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa557105-5d5a-46e1-a3c0-1d0252daaa61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:25.371716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa557105-5d5a-46e1-a3c0-1d0252daaa61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:25.372482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa557105-5d5a-46e1-a3c0-1d0252daaa61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:25.372918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fa557105-5d5a-46e1-a3c0-1d0252daaa61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:25.443461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fa557105-5d5a-46e1-a3c0-1d0252daaa61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:25.451367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fa557105-5d5a-46e1-a3c0-1d0252daaa61 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.091417 Jun 02 16:41:25.452416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1081/2401] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:25 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:26.469903 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6d13c1cf-82d9-4e4e-bf4d-4060b6c196ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:26.470497 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6d13c1cf-82d9-4e4e-bf4d-4060b6c196ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:26.477336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d13c1cf-82d9-4e4e-bf4d-4060b6c196ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:26.477794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d13c1cf-82d9-4e4e-bf4d-4060b6c196ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:26.478602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d13c1cf-82d9-4e4e-bf4d-4060b6c196ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:26.479045 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6d13c1cf-82d9-4e4e-bf4d-4060b6c196ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:26.543762 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6d13c1cf-82d9-4e4e-bf4d-4060b6c196ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:26.551772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6d13c1cf-82d9-4e4e-bf4d-4060b6c196ef tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086568 Jun 02 16:41:26.557360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1321/2402] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:26 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:27.568592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-dca2b858-21cb-4a91-8389-62af0d999e7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:27.569158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-dca2b858-21cb-4a91-8389-62af0d999e7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:27.575688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dca2b858-21cb-4a91-8389-62af0d999e7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:27.576137 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dca2b858-21cb-4a91-8389-62af0d999e7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:27.576898 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dca2b858-21cb-4a91-8389-62af0d999e7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:27.577345 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dca2b858-21cb-4a91-8389-62af0d999e7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:27.581200 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=84 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:41:27.637893 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-dca2b858-21cb-4a91-8389-62af0d999e7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:27.646277 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-dca2b858-21cb-4a91-8389-62af0d999e7e tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081555 Jun 02 16:41:27.646833 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1082/2403] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:27 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:28.663679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-0e42d725-7172-4564-8367-e70a2bb4bbbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:28.664237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-0e42d725-7172-4564-8367-e70a2bb4bbbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:28.670607 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e42d725-7172-4564-8367-e70a2bb4bbbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:28.671051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e42d725-7172-4564-8367-e70a2bb4bbbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:28.671800 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e42d725-7172-4564-8367-e70a2bb4bbbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:28.672229 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-0e42d725-7172-4564-8367-e70a2bb4bbbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:28.732864 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-0e42d725-7172-4564-8367-e70a2bb4bbbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:28.741336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-0e42d725-7172-4564-8367-e70a2bb4bbbc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081586 Jun 02 16:41:28.741892 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1322/2404] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:28 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:29.758339 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-688bf0af-d40b-49b8-ba6a-3a8712ca4b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:29.758962 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-688bf0af-d40b-49b8-ba6a-3a8712ca4b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:29.765612 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-688bf0af-d40b-49b8-ba6a-3a8712ca4b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:29.766055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-688bf0af-d40b-49b8-ba6a-3a8712ca4b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:29.767466 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-688bf0af-d40b-49b8-ba6a-3a8712ca4b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:29.767968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-688bf0af-d40b-49b8-ba6a-3a8712ca4b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:29.827881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-688bf0af-d40b-49b8-ba6a-3a8712ca4b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:29.836400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-688bf0af-d40b-49b8-ba6a-3a8712ca4b52 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081993 Jun 02 16:41:29.836959 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1083/2405] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:29 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:30.853489 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e03925a1-22a6-433e-917e-db7ad2ddb661 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:30.854154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e03925a1-22a6-433e-917e-db7ad2ddb661 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:30.860941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e03925a1-22a6-433e-917e-db7ad2ddb661 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:30.861390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e03925a1-22a6-433e-917e-db7ad2ddb661 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:30.862185 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e03925a1-22a6-433e-917e-db7ad2ddb661 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:30.862636 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e03925a1-22a6-433e-917e-db7ad2ddb661 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:30.923856 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e03925a1-22a6-433e-917e-db7ad2ddb661 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:30.931683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e03925a1-22a6-433e-917e-db7ad2ddb661 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082135 Jun 02 16:41:30.932255 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1323/2406] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:30 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:31.948195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a4fc0f92-bc94-456e-a0b1-6927ee1a6d65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:31.948805 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a4fc0f92-bc94-456e-a0b1-6927ee1a6d65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:31.955619 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4fc0f92-bc94-456e-a0b1-6927ee1a6d65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:31.956080 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4fc0f92-bc94-456e-a0b1-6927ee1a6d65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:31.956845 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4fc0f92-bc94-456e-a0b1-6927ee1a6d65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:31.957286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a4fc0f92-bc94-456e-a0b1-6927ee1a6d65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:32.021008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a4fc0f92-bc94-456e-a0b1-6927ee1a6d65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:32.028937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a4fc0f92-bc94-456e-a0b1-6927ee1a6d65 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084633 Jun 02 16:41:32.029504 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1084/2407] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:31 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:33.046827 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4709c745-13a3-4355-bd3c-3a254a8cb7ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:33.047473 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4709c745-13a3-4355-bd3c-3a254a8cb7ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:33.054334 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4709c745-13a3-4355-bd3c-3a254a8cb7ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:33.054789 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4709c745-13a3-4355-bd3c-3a254a8cb7ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:33.055554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4709c745-13a3-4355-bd3c-3a254a8cb7ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:33.055995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4709c745-13a3-4355-bd3c-3a254a8cb7ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:33.121167 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4709c745-13a3-4355-bd3c-3a254a8cb7ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:33.129644 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4709c745-13a3-4355-bd3c-3a254a8cb7ce tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.086658 Jun 02 16:41:33.130231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1324/2408] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:33 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:34.146553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b0c8ce13-eb2e-4b64-81e9-9463abc852ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:34.147163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b0c8ce13-eb2e-4b64-81e9-9463abc852ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:34.153559 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b0c8ce13-eb2e-4b64-81e9-9463abc852ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:34.154006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b0c8ce13-eb2e-4b64-81e9-9463abc852ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:34.154795 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b0c8ce13-eb2e-4b64-81e9-9463abc852ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:34.155228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b0c8ce13-eb2e-4b64-81e9-9463abc852ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:34.218597 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b0c8ce13-eb2e-4b64-81e9-9463abc852ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:34.227045 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b0c8ce13-eb2e-4b64-81e9-9463abc852ed tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084303 Jun 02 16:41:34.227599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1085/2409] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:34 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:35.244395 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8230bdd0-8610-43d1-8fa6-7ea745513250 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:35.245005 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8230bdd0-8610-43d1-8fa6-7ea745513250 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:35.252507 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8230bdd0-8610-43d1-8fa6-7ea745513250 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:35.252965 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8230bdd0-8610-43d1-8fa6-7ea745513250 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:35.253732 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8230bdd0-8610-43d1-8fa6-7ea745513250 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:35.254200 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8230bdd0-8610-43d1-8fa6-7ea745513250 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:35.315535 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8230bdd0-8610-43d1-8fa6-7ea745513250 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:35.323563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8230bdd0-8610-43d1-8fa6-7ea745513250 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082981 Jun 02 16:41:35.324123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1325/2410] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:35 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:36.340800 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-de56ebf5-0ad3-409a-ab2b-486de749ca90 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:36.341422 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-de56ebf5-0ad3-409a-ab2b-486de749ca90 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:36.348014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de56ebf5-0ad3-409a-ab2b-486de749ca90 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:36.348467 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de56ebf5-0ad3-409a-ab2b-486de749ca90 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:36.349232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de56ebf5-0ad3-409a-ab2b-486de749ca90 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:36.349671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-de56ebf5-0ad3-409a-ab2b-486de749ca90 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:36.411030 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-de56ebf5-0ad3-409a-ab2b-486de749ca90 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:36.418822 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-de56ebf5-0ad3-409a-ab2b-486de749ca90 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082090 Jun 02 16:41:36.419375 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1086/2411] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:36 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:37.435836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a588e3be-feea-4170-9187-5c1829184e0a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:37.436443 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a588e3be-feea-4170-9187-5c1829184e0a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:37.443060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a588e3be-feea-4170-9187-5c1829184e0a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:37.443519 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a588e3be-feea-4170-9187-5c1829184e0a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:37.444281 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a588e3be-feea-4170-9187-5c1829184e0a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:37.444724 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a588e3be-feea-4170-9187-5c1829184e0a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:37.447265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=84 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:41:37.505998 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a588e3be-feea-4170-9187-5c1829184e0a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:37.513993 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a588e3be-feea-4170-9187-5c1829184e0a tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082082 Jun 02 16:41:37.514586 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1326/2412] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:37 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:38.530849 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-90612e9d-ee3e-4593-be2e-7a2f60648926 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:38.531414 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-90612e9d-ee3e-4593-be2e-7a2f60648926 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:38.538488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-90612e9d-ee3e-4593-be2e-7a2f60648926 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:38.538942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-90612e9d-ee3e-4593-be2e-7a2f60648926 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:38.539705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-90612e9d-ee3e-4593-be2e-7a2f60648926 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:38.540143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-90612e9d-ee3e-4593-be2e-7a2f60648926 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:38.601162 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-90612e9d-ee3e-4593-be2e-7a2f60648926 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:38.609097 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-90612e9d-ee3e-4593-be2e-7a2f60648926 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.082166 Jun 02 16:41:38.609658 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1087/2413] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:38 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:39.627158 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-43d643d8-fc46-42a7-a3fe-599723100c72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:39.627709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-43d643d8-fc46-42a7-a3fe-599723100c72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:39.634345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43d643d8-fc46-42a7-a3fe-599723100c72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:39.634794 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43d643d8-fc46-42a7-a3fe-599723100c72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:39.635554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43d643d8-fc46-42a7-a3fe-599723100c72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:39.636042 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-43d643d8-fc46-42a7-a3fe-599723100c72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:39.696217 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-43d643d8-fc46-42a7-a3fe-599723100c72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:39.704130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-43d643d8-fc46-42a7-a3fe-599723100c72 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081377 Jun 02 16:41:39.705236 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1327/2414] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:39 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:40.722362 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-dfd2189a-e118-4c09-a0da-a89e253856cf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:40.722981 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-dfd2189a-e118-4c09-a0da-a89e253856cf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:40.729407 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dfd2189a-e118-4c09-a0da-a89e253856cf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:40.729854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dfd2189a-e118-4c09-a0da-a89e253856cf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:40.730647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dfd2189a-e118-4c09-a0da-a89e253856cf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:40.731083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dfd2189a-e118-4c09-a0da-a89e253856cf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:40.793892 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-dfd2189a-e118-4c09-a0da-a89e253856cf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:40.802461 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-dfd2189a-e118-4c09-a0da-a89e253856cf tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.084540 Jun 02 16:41:40.803020 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1088/2415] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:40 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:41.819894 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-63b41634-20ad-4bce-a046-01f9f92f6e56 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:41.820454 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-63b41634-20ad-4bce-a046-01f9f92f6e56 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:41.826983 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63b41634-20ad-4bce-a046-01f9f92f6e56 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:41.827435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63b41634-20ad-4bce-a046-01f9f92f6e56 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:41.828198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63b41634-20ad-4bce-a046-01f9f92f6e56 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:41.828638 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-63b41634-20ad-4bce-a046-01f9f92f6e56 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:41.895456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-63b41634-20ad-4bce-a046-01f9f92f6e56 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:41.903389 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-63b41634-20ad-4bce-a046-01f9f92f6e56 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.087481 Jun 02 16:41:41.903979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1328/2416] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:41 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:42.919229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5fd4c57c-9e2c-4b55-ba0f-bca59ea559ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:42.919824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5fd4c57c-9e2c-4b55-ba0f-bca59ea559ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:42.926406 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5fd4c57c-9e2c-4b55-ba0f-bca59ea559ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:42.926840 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5fd4c57c-9e2c-4b55-ba0f-bca59ea559ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:42.927591 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5fd4c57c-9e2c-4b55-ba0f-bca59ea559ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:42.928023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5fd4c57c-9e2c-4b55-ba0f-bca59ea559ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:42.988603 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5fd4c57c-9e2c-4b55-ba0f-bca59ea559ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb3d2dbcdb45bb8baba424e5239e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9598d078f4a1477babe0eaf804ef54a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:42.996490 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5fd4c57c-9e2c-4b55-ba0f-bca59ea559ff tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 200 len: 1367 microversion: 2.1 time: 0.081112 Jun 02 16:41:42.997048 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1089/2417] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:42 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:43.024338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cf2b7443-cca3-4252-a6cc-c608322cbd74 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '.version_select at 0x7f2d60b74040>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:43.109257 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cf2b7443-cca3-4252-a6cc-c608322cbd74 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-81450780" status: 202 len: 0 microversion: 2.1 time: 0.088646 Jun 02 16:41:43.109819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1329/2418] 10.222.0.59 () {58 vars in 1214 bytes} [Thu Jun 2 16:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-81450780 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:41:45.655209 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5843dca1-f3b3-4013-90f3-9a2b9d559614 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:45.655754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5843dca1-f3b3-4013-90f3-9a2b9d559614 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:45.666385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5843dca1-f3b3-4013-90f3-9a2b9d559614 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:45.666844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5843dca1-f3b3-4013-90f3-9a2b9d559614 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:45.667614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5843dca1-f3b3-4013-90f3-9a2b9d559614 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:45.668367 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5843dca1-f3b3-4013-90f3-9a2b9d559614 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:45.694747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5843dca1-f3b3-4013-90f3-9a2b9d559614 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Going to try to terminate instance {{(pid=118257) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:41:45.965716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5843dca1-f3b3-4013-90f3-9a2b9d559614 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 204 len: 0 microversion: 2.1 time: 0.313604 Jun 02 16:41:45.966273 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1090/2419] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:41:45 2022] DELETE /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:41:45.975683 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c2bf754d-2dc7-4701-af1d-56df3bfbe9b8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:45.976408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c2bf754d-2dc7-4701-af1d-56df3bfbe9b8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:45.983272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2bf754d-2dc7-4701-af1d-56df3bfbe9b8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:45.983716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2bf754d-2dc7-4701-af1d-56df3bfbe9b8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:45.984462 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2bf754d-2dc7-4701-af1d-56df3bfbe9b8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:45.984891 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c2bf754d-2dc7-4701-af1d-56df3bfbe9b8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:46.116686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c2bf754d-2dc7-4701-af1d-56df3bfbe9b8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:46.124047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c2bf754d-2dc7-4701-af1d-56df3bfbe9b8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1681 microversion: 2.1 time: 0.153481 Jun 02 16:41:46.124610 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1330/2420] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:45 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:41:46.197473 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:41:46.197633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:41:47.141546 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f156ec0b-0c24-44f1-837f-a7587ecaaf58 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:47.142785 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f156ec0b-0c24-44f1-837f-a7587ecaaf58 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:47.149078 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f156ec0b-0c24-44f1-837f-a7587ecaaf58 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:47.149521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f156ec0b-0c24-44f1-837f-a7587ecaaf58 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:47.150324 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f156ec0b-0c24-44f1-837f-a7587ecaaf58 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:47.150758 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f156ec0b-0c24-44f1-837f-a7587ecaaf58 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:47.353502 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f156ec0b-0c24-44f1-837f-a7587ecaaf58 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:47.361746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f156ec0b-0c24-44f1-837f-a7587ecaaf58 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1681 microversion: 2.1 time: 0.223816 Jun 02 16:41:47.362385 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1091/2421] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:47 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:47.843678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-3c9adca9-3d62-4701-8ed5-f3e445bdcb56 req-3adaec89-484a-47b8-9167-39427c53c366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3494b94-2b58-405b-8dfe-ddcbf9083330", "name": "network-vif-deleted", "tag": "54aef804-7280-4ada-a448-162d8dd21bb2"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:41:47.863252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-3c9adca9-3d62-4701-8ed5-f3e445bdcb56 req-3adaec89-484a-47b8-9167-39427c53c366 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:47.863252 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-3c9adca9-3d62-4701-8ed5-f3e445bdcb56 req-3adaec89-484a-47b8-9167-39427c53c366 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:47.865347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-3c9adca9-3d62-4701-8ed5-f3e445bdcb56 req-3adaec89-484a-47b8-9167-39427c53c366 service nova] Creating event network-vif-deleted:54aef804-7280-4ada-a448-162d8dd21bb2 for instance a3494b94-2b58-405b-8dfe-ddcbf9083330 on hv-cinder-79760 Jun 02 16:41:47.871878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-3c9adca9-3d62-4701-8ed5-f3e445bdcb56 req-3adaec89-484a-47b8-9167-39427c53c366 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094658 Jun 02 16:41:47.875415 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1331/2422] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:41:48.378850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:48.379400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:48.386046 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:48.386518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:48.387432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:48.387901 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:48.419730 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:48.420349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:48.420606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lazy-loading 'fault' on Instance uuid a3494b94-2b58-405b-8dfe-ddcbf9083330 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:41:48.463686 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:48.472336 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f3494adf-a138-49ca-bba8-a49c4269e185 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 200 len: 1331 microversion: 2.1 time: 0.098072 Jun 02 16:41:48.472918 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1092/2423] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:48 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:49.489987 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:49.490795 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:49.497568 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:49.498039 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:49.498837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:49.499295 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:49.512406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 HTTP/1.1 Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:41:49.513871 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:41:49.515752 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': 'a3494b94-2b58-405b-8dfe-ddcbf9083330'} Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:41:49.516852 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:41:49.519071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:41:49.521062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 404 to user: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:41:49.521062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-12b43d7f-0f71-4996-ac91-7777932a225d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 404 len: 111 microversion: 2.1 time: 0.030103 Jun 02 16:41:49.521062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1332/2424] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:49 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:41:49.524193 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-7c498eba-2617-49f5-9bb4-0c9c80000163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '.version_select at 0x7f2d5c3afca0>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:49.595213 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-7c498eba-2617-49f5-9bb4-0c9c80000163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-927997917" status: 202 len: 0 microversion: 2.1 time: 0.074715 Jun 02 16:41:49.595781 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1093/2425] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jun 2 16:41:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-927997917 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:41:50.338716 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f2d1fe84-e9f4-41b6-8f6c-58d50bc3ff10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Action: 'create', calling method: .version_select at 0x7f2d60bbaee0>, body: {"keypair": {"name": "tempest-keypair-1828339456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4olqg0ioQkuAcWSH1K6ajlhrpJ+20tqZZx1Sm4yPMzlfMUZ8cXdwX3Isvmw4xXmNZpsoSJgHRo/edYPPYcaWGIov2/wzPD8M6dD3OYZ06WOA/4s595y9uVeLIFBq9Mwg=="}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:41:50.353365 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-f2d1fe84-e9f4-41b6-8f6c-58d50bc3ff10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for project 17568d6be8f640359bd4c6ec666ea168. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:41:50.357132 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-f2d1fe84-e9f4-41b6-8f6c-58d50bc3ff10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for user f8503989cb4a4d9c8db260b403e07226 and project 17568d6be8f640359bd4c6ec666ea168. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:41:50.464431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f2d1fe84-e9f4-41b6-8f6c-58d50bc3ff10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129355 Jun 02 16:41:50.464968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1333/2426] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 2 16:41:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:41:52.804185 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-619595430", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c27844a7-dad1-4504-8943-6ba2accd51fc"}], "security_groups": [{"name": "tempest-securitygroup--963164994"}], "key_name": "tempest-keypair-1828339456", "user_data": "}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:41:52.904316 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] validate_networks() for [('c27844a7-dad1-4504-8943-6ba2accd51fc', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:41:53.326429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:41:53.326861 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:41:53.327338 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:41:53.327753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:41:53.328168 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:41:53.330116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:41:53.338437 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:53.343753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:53.343753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:53.343753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:53.357889 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for project 17568d6be8f640359bd4c6ec666ea168. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:41:53.361838 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for user f8503989cb4a4d9c8db260b403e07226 and project 17568d6be8f640359bd4c6ec666ea168. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:41:53.373174 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:41:53.375528 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:41:53.495736 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-992242b8-e475-4fed-a316-297f79094e73 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.696821 Jun 02 16:41:53.496301 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1094/2427] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:41:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:41:53.507722 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-239e1b82-a702-433d-a2e8-6e50efc2cb10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:53.508341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-239e1b82-a702-433d-a2e8-6e50efc2cb10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:53.567288 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-239e1b82-a702-433d-a2e8-6e50efc2cb10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:53.574916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-239e1b82-a702-433d-a2e8-6e50efc2cb10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1241 microversion: 2.1 time: 0.072546 Jun 02 16:41:53.575468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1334/2428] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:53 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:54.592919 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2c9b3e25-5973-466e-b555-f8fe1afb6703 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:54.593520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2c9b3e25-5973-466e-b555-f8fe1afb6703 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:54.600773 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2c9b3e25-5973-466e-b555-f8fe1afb6703 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:54.601229 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2c9b3e25-5973-466e-b555-f8fe1afb6703 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:54.601987 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2c9b3e25-5973-466e-b555-f8fe1afb6703 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:54.602453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2c9b3e25-5973-466e-b555-f8fe1afb6703 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:54.665645 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2c9b3e25-5973-466e-b555-f8fe1afb6703 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:54.673149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2c9b3e25-5973-466e-b555-f8fe1afb6703 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1245 microversion: 2.1 time: 0.084934 Jun 02 16:41:54.673708 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1095/2429] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:54 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:55.689749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ddd37a19-5ea0-4c68-ba02-3313ec3fa10e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:55.690384 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ddd37a19-5ea0-4c68-ba02-3313ec3fa10e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:55.692850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:41:55.700402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddd37a19-5ea0-4c68-ba02-3313ec3fa10e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:55.705302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddd37a19-5ea0-4c68-ba02-3313ec3fa10e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:55.709135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddd37a19-5ea0-4c68-ba02-3313ec3fa10e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:55.709609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ddd37a19-5ea0-4c68-ba02-3313ec3fa10e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:55.786287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ddd37a19-5ea0-4c68-ba02-3313ec3fa10e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:55.795338 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ddd37a19-5ea0-4c68-ba02-3313ec3fa10e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1299 microversion: 2.1 time: 0.109305 Jun 02 16:41:55.796266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1335/2430] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:55 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:56.814006 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-fdd462e3-1d7f-41a6-909a-b9904034ac47 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:56.814630 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-fdd462e3-1d7f-41a6-909a-b9904034ac47 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:56.823956 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fdd462e3-1d7f-41a6-909a-b9904034ac47 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:56.824757 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fdd462e3-1d7f-41a6-909a-b9904034ac47 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:56.826228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fdd462e3-1d7f-41a6-909a-b9904034ac47 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:56.826880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-fdd462e3-1d7f-41a6-909a-b9904034ac47 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:57.032413 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-fdd462e3-1d7f-41a6-909a-b9904034ac47 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:57.039784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-fdd462e3-1d7f-41a6-909a-b9904034ac47 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1366 microversion: 2.1 time: 0.230740 Jun 02 16:41:57.040348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1096/2431] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:56 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:57.204093 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-c738ac4f-3781-43c0-8111-e22b15a970bf req-060441b5-07dd-4424-a8d3-8025eee6cef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b7400e-e5fc-4ff4-a448-9922a5d2855f", "tag": "23972d6f-13d5-47db-9262-4bd640932d4d"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:41:57.218193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-c738ac4f-3781-43c0-8111-e22b15a970bf req-060441b5-07dd-4424-a8d3-8025eee6cef3 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:57.218640 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-c738ac4f-3781-43c0-8111-e22b15a970bf req-060441b5-07dd-4424-a8d3-8025eee6cef3 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:57.230597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-c738ac4f-3781-43c0-8111-e22b15a970bf req-060441b5-07dd-4424-a8d3-8025eee6cef3 service nova] Creating event network-changed:23972d6f-13d5-47db-9262-4bd640932d4d for instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f on hv-cinder-79760 Jun 02 16:41:57.235585 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-c738ac4f-3781-43c0-8111-e22b15a970bf req-060441b5-07dd-4424-a8d3-8025eee6cef3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035120 Jun 02 16:41:57.239488 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1336/2432] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:41:58.056702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-51feb64d-bbb2-439f-ad41-6e8b872990a2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:58.057266 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-51feb64d-bbb2-439f-ad41-6e8b872990a2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:58.063905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-51feb64d-bbb2-439f-ad41-6e8b872990a2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:58.064355 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-51feb64d-bbb2-439f-ad41-6e8b872990a2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:58.065117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-51feb64d-bbb2-439f-ad41-6e8b872990a2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:58.065553 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-51feb64d-bbb2-439f-ad41-6e8b872990a2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:58.069370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:41:58.200390 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-51feb64d-bbb2-439f-ad41-6e8b872990a2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:58.207899 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-51feb64d-bbb2-439f-ad41-6e8b872990a2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1366 microversion: 2.1 time: 0.155149 Jun 02 16:41:58.208457 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1097/2433] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:58 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:41:59.226040 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2365f520-3a11-4a0f-b69f-95b20f86e1c9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:41:59.226766 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2365f520-3a11-4a0f-b69f-95b20f86e1c9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:41:59.233159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2365f520-3a11-4a0f-b69f-95b20f86e1c9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:59.233611 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2365f520-3a11-4a0f-b69f-95b20f86e1c9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:59.234402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2365f520-3a11-4a0f-b69f-95b20f86e1c9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:41:59.234844 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2365f520-3a11-4a0f-b69f-95b20f86e1c9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:41:59.364224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2365f520-3a11-4a0f-b69f-95b20f86e1c9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:41:59.371577 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2365f520-3a11-4a0f-b69f-95b20f86e1c9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1366 microversion: 2.1 time: 0.150665 Jun 02 16:41:59.372137 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1337/2434] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:41:59 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:42:00.388705 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9732f77f-4dc1-4c2f-be1f-81345ac20c5b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:42:00.389376 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9732f77f-4dc1-4c2f-be1f-81345ac20c5b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:42:00.396752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9732f77f-4dc1-4c2f-be1f-81345ac20c5b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:00.397205 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9732f77f-4dc1-4c2f-be1f-81345ac20c5b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:00.397973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9732f77f-4dc1-4c2f-be1f-81345ac20c5b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:00.398439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9732f77f-4dc1-4c2f-be1f-81345ac20c5b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:00.530634 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-9732f77f-4dc1-4c2f-be1f-81345ac20c5b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:42:00.538680 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9732f77f-4dc1-4c2f-be1f-81345ac20c5b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1366 microversion: 2.1 time: 0.153893 Jun 02 16:42:00.539237 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1098/2435] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:42:00 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:42:01.556129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c3cf0a0d-7913-44a0-b793-05a4b8ef5655 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:42:01.556694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c3cf0a0d-7913-44a0-b793-05a4b8ef5655 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:42:01.563079 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3cf0a0d-7913-44a0-b793-05a4b8ef5655 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:01.563526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3cf0a0d-7913-44a0-b793-05a4b8ef5655 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:01.564272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3cf0a0d-7913-44a0-b793-05a4b8ef5655 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:01.564700 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c3cf0a0d-7913-44a0-b793-05a4b8ef5655 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:01.692198 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c3cf0a0d-7913-44a0-b793-05a4b8ef5655 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:42:01.699560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c3cf0a0d-7913-44a0-b793-05a4b8ef5655 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1366 microversion: 2.1 time: 0.147331 Jun 02 16:42:01.700108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1338/2436] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:42:01 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:42:02.716586 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-65a6f21e-24bd-4970-96d9-e27d5e117a85 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:42:02.717464 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-65a6f21e-24bd-4970-96d9-e27d5e117a85 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:42:02.724689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65a6f21e-24bd-4970-96d9-e27d5e117a85 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:02.725083 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65a6f21e-24bd-4970-96d9-e27d5e117a85 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:02.725859 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65a6f21e-24bd-4970-96d9-e27d5e117a85 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:02.726358 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-65a6f21e-24bd-4970-96d9-e27d5e117a85 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:02.860254 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-65a6f21e-24bd-4970-96d9-e27d5e117a85 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:42:02.868771 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-65a6f21e-24bd-4970-96d9-e27d5e117a85 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1366 microversion: 2.1 time: 0.155947 Jun 02 16:42:02.869323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1099/2437] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:42:02 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:42:03.885839 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f482e79c-8dae-4904-91ba-b90cbf973d10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:42:03.886426 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f482e79c-8dae-4904-91ba-b90cbf973d10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:42:03.888909 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=6 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:42:03.893686 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f482e79c-8dae-4904-91ba-b90cbf973d10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:03.894176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f482e79c-8dae-4904-91ba-b90cbf973d10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:03.895625 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f482e79c-8dae-4904-91ba-b90cbf973d10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:03.896061 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f482e79c-8dae-4904-91ba-b90cbf973d10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:04.025009 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f482e79c-8dae-4904-91ba-b90cbf973d10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:42:04.032266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f482e79c-8dae-4904-91ba-b90cbf973d10 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1366 microversion: 2.1 time: 0.150405 Jun 02 16:42:04.032863 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1339/2438] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:42:03 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:42:04.614712 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:42:04.615691 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=6 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:42:04.665120 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-3d4f2ece-d495-4351-90fc-313d40ef2cc1 req-7efc11b8-6841-4ebb-8acd-12671fab1ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b7400e-e5fc-4ff4-a448-9922a5d2855f", "name": "network-vif-plugged", "status": "completed", "tag": "23972d6f-13d5-47db-9262-4bd640932d4d"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:42:04.673199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-3d4f2ece-d495-4351-90fc-313d40ef2cc1 req-7efc11b8-6841-4ebb-8acd-12671fab1ca2 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:04.673648 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-3d4f2ece-d495-4351-90fc-313d40ef2cc1 req-7efc11b8-6841-4ebb-8acd-12671fab1ca2 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:04.685075 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-3d4f2ece-d495-4351-90fc-313d40ef2cc1 req-7efc11b8-6841-4ebb-8acd-12671fab1ca2 service nova] Creating event network-vif-plugged:23972d6f-13d5-47db-9262-4bd640932d4d for instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f on hv-cinder-79760 Jun 02 16:42:04.690336 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-3d4f2ece-d495-4351-90fc-313d40ef2cc1 req-7efc11b8-6841-4ebb-8acd-12671fab1ca2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080674 Jun 02 16:42:04.691169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1100/2439] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:42:05.048958 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-6491e97c-79c0-4fad-afa0-41af8a78951a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:42:05.049574 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-6491e97c-79c0-4fad-afa0-41af8a78951a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:42:05.056028 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6491e97c-79c0-4fad-afa0-41af8a78951a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:05.056480 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6491e97c-79c0-4fad-afa0-41af8a78951a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:05.057246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6491e97c-79c0-4fad-afa0-41af8a78951a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:05.057681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-6491e97c-79c0-4fad-afa0-41af8a78951a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:05.186438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-6491e97c-79c0-4fad-afa0-41af8a78951a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:42:05.194826 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-6491e97c-79c0-4fad-afa0-41af8a78951a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1366 microversion: 2.1 time: 0.149835 Jun 02 16:42:05.195381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1340/2440] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:42:05 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:42:06.212659 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-cb25f063-6957-4acb-bfd6-1e63a5180d54 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:42:06.213369 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-cb25f063-6957-4acb-bfd6-1e63a5180d54 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:42:06.221990 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb25f063-6957-4acb-bfd6-1e63a5180d54 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:06.222494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb25f063-6957-4acb-bfd6-1e63a5180d54 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:06.223294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb25f063-6957-4acb-bfd6-1e63a5180d54 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:06.223728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-cb25f063-6957-4acb-bfd6-1e63a5180d54 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:06.353300 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-cb25f063-6957-4acb-bfd6-1e63a5180d54 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:42:06.360982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-cb25f063-6957-4acb-bfd6-1e63a5180d54 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1366 microversion: 2.1 time: 0.152498 Jun 02 16:42:06.361533 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1101/2441] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:42:06 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:42:07.377944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d296de61-cab9-4f6c-997e-9d448a9f7a05 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:42:07.378660 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d296de61-cab9-4f6c-997e-9d448a9f7a05 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:42:07.385287 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d296de61-cab9-4f6c-997e-9d448a9f7a05 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:07.385735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d296de61-cab9-4f6c-997e-9d448a9f7a05 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:07.386560 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d296de61-cab9-4f6c-997e-9d448a9f7a05 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:07.387023 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d296de61-cab9-4f6c-997e-9d448a9f7a05 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:07.519397 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d296de61-cab9-4f6c-997e-9d448a9f7a05 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:42:07.525530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=64 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:42:07.527969 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d296de61-cab9-4f6c-997e-9d448a9f7a05 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1557 microversion: 2.1 time: 0.153878 Jun 02 16:42:07.528536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1341/2442] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:42:07 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:42:07.544751 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-dbeddef6-ae57-4dfe-9c99-3618915e24f0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:42:07.548348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-dbeddef6-ae57-4dfe-9c99-3618915e24f0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:42:07.551870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dbeddef6-ae57-4dfe-9c99-3618915e24f0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:07.552287 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dbeddef6-ae57-4dfe-9c99-3618915e24f0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:07.553079 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dbeddef6-ae57-4dfe-9c99-3618915e24f0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:07.553518 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-dbeddef6-ae57-4dfe-9c99-3618915e24f0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:07.635873 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-dbeddef6-ae57-4dfe-9c99-3618915e24f0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094932 Jun 02 16:42:07.636491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1102/2443] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 2 16:42:07 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:42:08.602531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-08987721-b050-4f17-9b0f-82249d15599f req-4960bf10-de2f-453a-b3e0-094698ab9d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b7400e-e5fc-4ff4-a448-9922a5d2855f", "tag": "23972d6f-13d5-47db-9262-4bd640932d4d"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:42:08.611381 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-08987721-b050-4f17-9b0f-82249d15599f req-4960bf10-de2f-453a-b3e0-094698ab9d48 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:42:08.612059 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-08987721-b050-4f17-9b0f-82249d15599f req-4960bf10-de2f-453a-b3e0-094698ab9d48 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:42:08.623806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-08987721-b050-4f17-9b0f-82249d15599f req-4960bf10-de2f-453a-b3e0-094698ab9d48 service nova] Creating event network-changed:23972d6f-13d5-47db-9262-4bd640932d4d for instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f on hv-cinder-79760 Jun 02 16:42:08.629010 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-08987721-b050-4f17-9b0f-82249d15599f req-4960bf10-de2f-453a-b3e0-094698ab9d48 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030664 Jun 02 16:42:08.629612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1342/2444] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:43:10.919875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:43:10.920615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:43:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:43:13.353470 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:43:13.354319 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=29 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:43:13.358573 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-246b4f5d-0a34-4713-8bd4-3f95a093710d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:43:13.359116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-246b4f5d-0a34-4713-8bd4-3f95a093710d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:43:13.365241 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-246b4f5d-0a34-4713-8bd4-3f95a093710d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:43:13.365692 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-246b4f5d-0a34-4713-8bd4-3f95a093710d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:43:13.366493 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-246b4f5d-0a34-4713-8bd4-3f95a093710d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:43:13.366931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-246b4f5d-0a34-4713-8bd4-3f95a093710d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:43:13.392196 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-246b4f5d-0a34-4713-8bd4-3f95a093710d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/ips" status: 200 len: 151 microversion: 2.1 time: 0.040821 Jun 02 16:43:13.392768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1103/2445] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 2 16:43:13 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:44:52.414240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:44:52.414843 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:44:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:45:00.121361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:45:00.121973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:45:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:45:06.206803 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:45:06.207361 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:45:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:45:06.514119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:45:06.514323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:45:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:45:19.613595 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:45:19.614284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:46:30.929336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:46:30.929982 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:47:47.813765 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03f18a5f-16f8-4d1e-9b11-19a2f9ea635f] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 16:47:47.814435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=15 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:47:47.815182 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=3 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:47:47.819820 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-668b82fb-f5b4-4a5a-8aa7-e8fd5e3f21b1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "763a50db-50da-4d08-8278-a1e272ed703d"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:47:47.821800 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-668b82fb-f5b4-4a5a-8aa7-e8fd5e3f21b1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:47.828714 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-668b82fb-f5b4-4a5a-8aa7-e8fd5e3f21b1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:47.829166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-668b82fb-f5b4-4a5a-8aa7-e8fd5e3f21b1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:47.829931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-668b82fb-f5b4-4a5a-8aa7-e8fd5e3f21b1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:47.830408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-668b82fb-f5b4-4a5a-8aa7-e8fd5e3f21b1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:48.821124 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] [03f18a5f-16f8-4d1e-9b11-19a2f9ea635f] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 57730. Jun 02 16:47:50.828104 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-668b82fb-f5b4-4a5a-8aa7-e8fd5e3f21b1 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "POST /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.015782 Jun 02 16:47:50.828822 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1343/2446] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:47:47 2022] POST /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments => generated 194 bytes in 3018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:47:53.089557 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0b26d8c-50e0-4499-bd8d-bed6311a08a7] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 02 16:47:53.094549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:47:53.095106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:53.101863 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:53.102352 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:53.103117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:53.103549 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:53.116733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] HTTP exception thrown: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Request method failure captured: Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 HTTP/1.1 Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOAOBmBuaexkTflPXcayAEThTbf8iE3BWp3JtDWfPGIjHoJ9ACyeyuDs16-SCzAeNmT0gqjDo6UB6yigj8cXMNgNeNMGOHXSve2C1UsOfAJST4nsVa9n-ULUM_EDhNU41RY93sDE6G5YaVjq7a_bYn6xn8uDBzZWw-oNXDltc5ewS_Q Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:47:53.120474 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}] Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 88bb3d2dbcdb45bb8baba424e5239e21 Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.122373 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': 'a4d978fa-9abe-42e1-af29-1ccea22ff4c9'} Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:47:53.123616 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.125292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.127067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Returning 404 to user: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:47:53.127067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-424fdd6b-4d34-435a-b24e-01229d36ad05 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 404 len: 111 microversion: 2.1 time: 0.033066 Jun 02 16:47:53.127067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1104/2447] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:47:53 2022] DELETE /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:47:53.129351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:47:53.130058 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: a4d978fa-9abe-42e1-af29-1ccea22ff4c9] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:53.137481 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:53.137936 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:53.139333 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:53.140060 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:53.156105 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] HTTP exception thrown: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Request method failure captured: Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 HTTP/1.1 Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOAOBmBuaexkTflPXcayAEThTbf8iE3BWp3JtDWfPGIjHoJ9ACyeyuDs16-SCzAeNmT0gqjDo6UB6yigj8cXMNgNeNMGOHXSve2C1UsOfAJST4nsVa9n-ULUM_EDhNU41RY93sDE6G5YaVjq7a_bYn6xn8uDBzZWw-oNXDltc5ewS_Q Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:47:53.157709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}] Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 88bb3d2dbcdb45bb8baba424e5239e21 Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.159477 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': 'a4d978fa-9abe-42e1-af29-1ccea22ff4c9'} Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:47:53.160547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. Jun 02 16:47:53.162273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:53.163870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Returning 404 to user: Instance a4d978fa-9abe-42e1-af29-1ccea22ff4c9 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:47:53.163870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-cfc6e870-cfb0-42c0-958e-8875f8d167d1 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9" status: 404 len: 111 microversion: 2.1 time: 0.034171 Jun 02 16:47:53.163870 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1344/2448] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:47:53 2022] GET /compute/v2.1/servers/a4d978fa-9abe-42e1-af29-1ccea22ff4c9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:47:53.385268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-864825681", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "networks": [{"uuid": "e2ac7678-4aba-4dea-bbee-525843f1daf4"}]}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:47:53.552138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] validate_networks() for [('e2ac7678-4aba-4dea-bbee-525843f1daf4', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:47:53.983507 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:47:53.983927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:47:53.984445 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:47:53.984856 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:47:53.985268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:47:54.002290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:54.002290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:54.002290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:54.002290 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:54.013767 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Getting quotas for project f556a2c3bb1c45f0a3607912effac5c8. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:47:54.017811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Getting quotas for user 2910f2833ce24b17b248ad9106f19786 and project f556a2c3bb1c45f0a3607912effac5c8. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:47:54.028964 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:47:54.031283 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:47:54.098569 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0b26d8c-50e0-4499-bd8d-bed6311a08a7] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 57794. Jun 02 16:47:54.156171 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-52d1c198-ab33-4d06-8288-fdca5561d43c tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774991 Jun 02 16:47:54.156810 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1105/2449] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 16:47:54.166536 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7558169e-60c7-4052-9c97-01913f191376 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:47:54.167166 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-7558169e-60c7-4052-9c97-01913f191376 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:54.224163 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-7558169e-60c7-4052-9c97-01913f191376 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:47:54.230974 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7558169e-60c7-4052-9c97-01913f191376 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1218 microversion: 2.1 time: 0.068155 Jun 02 16:47:54.231777 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1345/2450] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:47:54 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:47:54.443210 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:47:54.444015 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:54.452776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:54.453220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:54.453992 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:54.454455 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:54.471268 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] HTTP exception thrown: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Request method failure captured: Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 HTTP/1.1 Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOAOBmBuaexkTflPXcayAEThTbf8iE3BWp3JtDWfPGIjHoJ9ACyeyuDs16-SCzAeNmT0gqjDo6UB6yigj8cXMNgNeNMGOHXSve2C1UsOfAJST4nsVa9n-ULUM_EDhNU41RY93sDE6G5YaVjq7a_bYn6xn8uDBzZWw-oNXDltc5ewS_Q Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:47:54.473789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}] Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: 88bb3d2dbcdb45bb8baba424e5239e21 Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.475580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '90430f1e-1a79-4ab9-b7f7-c44ee8c064d5'} Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:47:54.476594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.478370 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.480019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Returning 404 to user: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:47:54.480019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ee6b92b9-0037-442a-a57c-5c7987d89e37 tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "DELETE /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 404 len: 111 microversion: 2.1 time: 0.035137 Jun 02 16:47:54.480019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1106/2451] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:47:54 2022] DELETE /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:47:54.483750 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:47:54.484340 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] [instance: 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:54.491112 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:54.491819 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:54.492584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:54.493025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:54.506409 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] HTTP exception thrown: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Request method failure captured: Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 HTTP/1.1 Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOAOBmBuaexkTflPXcayAEThTbf8iE3BWp3JtDWfPGIjHoJ9ACyeyuDs16-SCzAeNmT0gqjDo6UB6yigj8cXMNgNeNMGOHXSve2C1UsOfAJST4nsVa9n-ULUM_EDhNU41RY93sDE6G5YaVjq7a_bYn6xn8uDBzZWw-oNXDltc5ewS_Q Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:47:54.508026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9598d078f4a1477babe0eaf804ef54a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9598d078f4a1477babe0eaf804ef54a8"}]}] Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 9598d078f4a1477babe0eaf804ef54a8 Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1050384827 Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 88bb3d2dbcdb45bb8baba424e5239e21 Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-AttachVolumeTestJSON-1050384827-project Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.510729 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '90430f1e-1a79-4ab9-b7f7-c44ee8c064d5'} Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:47:54.514749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. Jun 02 16:47:54.516573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:47:54.518129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] Returning 404 to user: Instance 90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:47:54.518129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-18b9c27f-1d03-4c3d-97e4-de2fb9ec62bc tempest-AttachVolumeTestJSON-1050384827 tempest-AttachVolumeTestJSON-1050384827-project] 10.222.0.59 "GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5" status: 404 len: 111 microversion: 2.1 time: 0.030312 Jun 02 16:47:54.518129 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1346/2452] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:47:54 2022] GET /compute/v2.1/servers/90430f1e-1a79-4ab9-b7f7-c44ee8c064d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:47:55.248646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d7a34d14-3af2-4aec-bdfa-e39c4c66aee0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:47:55.249364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d7a34d14-3af2-4aec-bdfa-e39c4c66aee0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:55.256084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7a34d14-3af2-4aec-bdfa-e39c4c66aee0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:55.256647 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7a34d14-3af2-4aec-bdfa-e39c4c66aee0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:55.257492 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7a34d14-3af2-4aec-bdfa-e39c4c66aee0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:55.257993 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d7a34d14-3af2-4aec-bdfa-e39c4c66aee0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:55.336726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d7a34d14-3af2-4aec-bdfa-e39c4c66aee0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:47:55.339975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d7a34d14-3af2-4aec-bdfa-e39c4c66aee0 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1222 microversion: 2.1 time: 0.095273 Jun 02 16:47:55.340646 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1107/2453] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:47:55 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:47:56.357841 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-89d51291-9c60-4211-a213-b4f6480d4a05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:47:56.359621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-89d51291-9c60-4211-a213-b4f6480d4a05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:56.367760 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89d51291-9c60-4211-a213-b4f6480d4a05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:56.368911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89d51291-9c60-4211-a213-b4f6480d4a05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:56.369859 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89d51291-9c60-4211-a213-b4f6480d4a05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:56.370735 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-89d51291-9c60-4211-a213-b4f6480d4a05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:56.440654 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-89d51291-9c60-4211-a213-b4f6480d4a05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:47:56.448438 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-89d51291-9c60-4211-a213-b4f6480d4a05 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1288 microversion: 2.1 time: 0.095290 Jun 02 16:47:56.448995 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1347/2454] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:47:56 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:47:57.467453 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bec6057e-bcef-4d61-a381-e4ec63271b82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:47:57.469287 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bec6057e-bcef-4d61-a381-e4ec63271b82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:57.479180 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bec6057e-bcef-4d61-a381-e4ec63271b82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:57.479821 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bec6057e-bcef-4d61-a381-e4ec63271b82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:57.480765 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bec6057e-bcef-4d61-a381-e4ec63271b82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:57.481580 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bec6057e-bcef-4d61-a381-e4ec63271b82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:58.021243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bec6057e-bcef-4d61-a381-e4ec63271b82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:47:58.028931 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bec6057e-bcef-4d61-a381-e4ec63271b82 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.566265 Jun 02 16:47:58.030391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1108/2455] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:47:57 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:47:58.637997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-04a9815b-d3e5-47c7-8c98-4b4b16e48714 req-8780be28-dd43-450b-b5b1-5dd9bd79776e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541603d2-303b-40d4-b62f-e93198338893", "tag": "7faeeaff-0468-43f6-80ee-8d6375195eb2"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:47:58.653475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-04a9815b-d3e5-47c7-8c98-4b4b16e48714 req-8780be28-dd43-450b-b5b1-5dd9bd79776e service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:58.653475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-04a9815b-d3e5-47c7-8c98-4b4b16e48714 req-8780be28-dd43-450b-b5b1-5dd9bd79776e service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:58.658563 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-04a9815b-d3e5-47c7-8c98-4b4b16e48714 req-8780be28-dd43-450b-b5b1-5dd9bd79776e service nova] Creating event network-changed:7faeeaff-0468-43f6-80ee-8d6375195eb2 for instance 541603d2-303b-40d4-b62f-e93198338893 on hv-cinder-79760 Jun 02 16:47:58.663569 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-04a9815b-d3e5-47c7-8c98-4b4b16e48714 req-8780be28-dd43-450b-b5b1-5dd9bd79776e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110122 Jun 02 16:47:58.666456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1348/2456] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:47:59.047600 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5c1e7964-e5b9-4036-9a99-004c61c8436f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:47:59.048158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5c1e7964-e5b9-4036-9a99-004c61c8436f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:47:59.054571 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c1e7964-e5b9-4036-9a99-004c61c8436f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:59.055023 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c1e7964-e5b9-4036-9a99-004c61c8436f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:59.055784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c1e7964-e5b9-4036-9a99-004c61c8436f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:47:59.056220 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5c1e7964-e5b9-4036-9a99-004c61c8436f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:47:59.187536 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-5c1e7964-e5b9-4036-9a99-004c61c8436f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:47:59.195248 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5c1e7964-e5b9-4036-9a99-004c61c8436f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.152119 Jun 02 16:47:59.195811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1109/2457] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:47:59 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:00.219493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4bc6fd62-9314-4444-8866-4e12c6e39084 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:00.222047 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4bc6fd62-9314-4444-8866-4e12c6e39084 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:00.228643 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4bc6fd62-9314-4444-8866-4e12c6e39084 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:00.229098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4bc6fd62-9314-4444-8866-4e12c6e39084 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:00.230057 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4bc6fd62-9314-4444-8866-4e12c6e39084 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:00.230697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4bc6fd62-9314-4444-8866-4e12c6e39084 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:00.391552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4bc6fd62-9314-4444-8866-4e12c6e39084 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:00.399201 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4bc6fd62-9314-4444-8866-4e12c6e39084 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.186271 Jun 02 16:48:00.401178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1349/2458] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:00 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:00.508416 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "763a50db-50da-4d08-8278-a1e272ed703d"}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:00.509562 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:00.516913 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:00.517391 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:00.522286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:00.522286 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:00.609824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Invalid volume: volume 763a50db-50da-4d08-8278-a1e272ed703d is already attached to instances: 20b7400e-e5fc-4ff4-a448-9922a5d2855f Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: POST /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments HTTP/1.1 Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 74 Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:48:00.611521 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {"volumeAttachment": {"volumeId": "763a50db-50da-4d08-8278-a1e272ed703d"}} Jun 02 16:48:00.613053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Invalid volume: volume 763a50db-50da-4d08-8278-a1e272ed703d is already attached to instances: 20b7400e-e5fc-4ff4-a448-9922a5d2855f Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'server_id': '20b7400e-e5fc-4ff4-a448-9922a5d2855f', 'body': {'volumeAttachment': {'volumeId': '763a50db-50da-4d08-8278-a1e272ed703d'}}} Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 763a50db-50da-4d08-8278-a1e272ed703d is already attached to instances: 20b7400e-e5fc-4ff4-a448-9922a5d2855f Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:00.614514 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 763a50db-50da-4d08-8278-a1e272ed703d is already attached to instances: 20b7400e-e5fc-4ff4-a448-9922a5d2855f Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:48:00.615896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:48:00.617941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:48:00.617941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:48:00.617941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:48:00.617941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 763a50db-50da-4d08-8278-a1e272ed703d is already attached to instances: 20b7400e-e5fc-4ff4-a448-9922a5d2855f Jun 02 16:48:00.617941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:00.617941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 400 to user: Invalid volume: volume 763a50db-50da-4d08-8278-a1e272ed703d is already attached to instances: 20b7400e-e5fc-4ff4-a448-9922a5d2855f {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:48:00.617941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1144e8a3-2891-46a7-ac50-15d61427f439 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "POST /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108702 Jun 02 16:48:00.617941 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1110/2459] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:48:00 2022] POST /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 16:48:00.678135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-910c7e8f-5e09-4fb3-9838-ffd12d084f4f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:00.678813 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-910c7e8f-5e09-4fb3-9838-ffd12d084f4f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:00.684817 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-910c7e8f-5e09-4fb3-9838-ffd12d084f4f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:00.685265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-910c7e8f-5e09-4fb3-9838-ffd12d084f4f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:00.686673 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-910c7e8f-5e09-4fb3-9838-ffd12d084f4f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:00.687110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-910c7e8f-5e09-4fb3-9838-ffd12d084f4f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:00.770704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-910c7e8f-5e09-4fb3-9838-ffd12d084f4f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lazy-loading 'services' on Instance uuid 20b7400e-e5fc-4ff4-a448-9922a5d2855f {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:48:00.937934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-910c7e8f-5e09-4fb3-9838-ffd12d084f4f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments/763a50db-50da-4d08-8278-a1e272ed703d" status: 202 len: 0 microversion: 2.1 time: 0.264255 Jun 02 16:48:00.938667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1350/2460] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:48:00 2022] DELETE /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments/763a50db-50da-4d08-8278-a1e272ed703d => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:48:00.947405 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d004081a-c814-4aec-a528-d6d4516aebfe tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:00.948364 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d004081a-c814-4aec-a528-d6d4516aebfe tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:00.954675 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d004081a-c814-4aec-a528-d6d4516aebfe tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:00.955148 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d004081a-c814-4aec-a528-d6d4516aebfe tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:00.956295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d004081a-c814-4aec-a528-d6d4516aebfe tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:00.956702 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d004081a-c814-4aec-a528-d6d4516aebfe tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:00.986656 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d004081a-c814-4aec-a528-d6d4516aebfe tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Jun 02 16:48:00.987198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1111/2461] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:48:00 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:48:01.419271 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-45941022-f800-452a-9c45-865fc580c885 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:01.419952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-45941022-f800-452a-9c45-865fc580c885 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:01.426402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-45941022-f800-452a-9c45-865fc580c885 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:01.426923 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-45941022-f800-452a-9c45-865fc580c885 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:01.427907 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-45941022-f800-452a-9c45-865fc580c885 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:01.428347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-45941022-f800-452a-9c45-865fc580c885 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:01.558440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-45941022-f800-452a-9c45-865fc580c885 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:01.566502 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-45941022-f800-452a-9c45-865fc580c885 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.152023 Jun 02 16:48:01.567062 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1351/2462] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:01 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:01.998858 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-9822b3f3-6100-467a-baac-c6b66ccaffe6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:01.999784 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-9822b3f3-6100-467a-baac-c6b66ccaffe6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:02.006389 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9822b3f3-6100-467a-baac-c6b66ccaffe6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:02.006844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9822b3f3-6100-467a-baac-c6b66ccaffe6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:02.007679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9822b3f3-6100-467a-baac-c6b66ccaffe6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:02.008117 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-9822b3f3-6100-467a-baac-c6b66ccaffe6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:02.038732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-9822b3f3-6100-467a-baac-c6b66ccaffe6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Jun 02 16:48:02.039285 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1112/2463] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:48:01 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:48:02.583486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-261eae8a-3e2e-459d-8bd2-8e5ab13d8ded tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:02.584090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-261eae8a-3e2e-459d-8bd2-8e5ab13d8ded tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:02.590493 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-261eae8a-3e2e-459d-8bd2-8e5ab13d8ded tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:02.590934 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-261eae8a-3e2e-459d-8bd2-8e5ab13d8ded tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:02.591680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-261eae8a-3e2e-459d-8bd2-8e5ab13d8ded tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:02.592204 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-261eae8a-3e2e-459d-8bd2-8e5ab13d8ded tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:02.725402 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-261eae8a-3e2e-459d-8bd2-8e5ab13d8ded tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:02.733557 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-261eae8a-3e2e-459d-8bd2-8e5ab13d8ded tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.153891 Jun 02 16:48:02.734159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1352/2464] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:02 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:03.051844 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d28e4ec7-9bbf-4bc2-ba26-f2b4284535dc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:03.052786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d28e4ec7-9bbf-4bc2-ba26-f2b4284535dc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:03.059684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d28e4ec7-9bbf-4bc2-ba26-f2b4284535dc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:03.060484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d28e4ec7-9bbf-4bc2-ba26-f2b4284535dc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:03.061877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d28e4ec7-9bbf-4bc2-ba26-f2b4284535dc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:03.062858 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d28e4ec7-9bbf-4bc2-ba26-f2b4284535dc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:03.096688 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d28e4ec7-9bbf-4bc2-ba26-f2b4284535dc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049581 Jun 02 16:48:03.097243 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1113/2465] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:48:03 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:48:03.750941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-76d2772b-69cf-4856-8a72-a141cd165730 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:03.751550 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-76d2772b-69cf-4856-8a72-a141cd165730 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:03.758039 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76d2772b-69cf-4856-8a72-a141cd165730 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:03.758518 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76d2772b-69cf-4856-8a72-a141cd165730 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:03.759272 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76d2772b-69cf-4856-8a72-a141cd165730 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:03.759702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-76d2772b-69cf-4856-8a72-a141cd165730 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:03.901261 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-76d2772b-69cf-4856-8a72-a141cd165730 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:03.908850 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-76d2772b-69cf-4856-8a72-a141cd165730 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.162361 Jun 02 16:48:03.909408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1353/2466] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:03 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:04.109650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0619b5fb-67ba-4007-836a-d43b3cb9220c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:04.110570 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0619b5fb-67ba-4007-836a-d43b3cb9220c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:04.112590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:04.113275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=6 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:04.119351 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0619b5fb-67ba-4007-836a-d43b3cb9220c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:04.122679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0619b5fb-67ba-4007-836a-d43b3cb9220c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:04.122679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0619b5fb-67ba-4007-836a-d43b3cb9220c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:04.122679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0619b5fb-67ba-4007-836a-d43b3cb9220c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:04.150622 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0619b5fb-67ba-4007-836a-d43b3cb9220c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045928 Jun 02 16:48:04.152709 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1114/2467] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:48:04 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 16:48:04.209626 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-b0294090-d3d8-4b42-b263-64ba8378c5ac tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:04.210203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b0294090-d3d8-4b42-b263-64ba8378c5ac tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:04.216298 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0294090-d3d8-4b42-b263-64ba8378c5ac tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:04.216772 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0294090-d3d8-4b42-b263-64ba8378c5ac tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:04.217680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0294090-d3d8-4b42-b263-64ba8378c5ac tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:04.218135 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-b0294090-d3d8-4b42-b263-64ba8378c5ac tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:04.233886 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=2 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:04.244360 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-b0294090-d3d8-4b42-b263-64ba8378c5ac tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:48:04.469968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-b0294090-d3d8-4b42-b263-64ba8378c5ac tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 204 len: 0 microversion: 2.1 time: 0.263833 Jun 02 16:48:04.470602 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1354/2468] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:48:04 2022] DELETE /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:48:04.479292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-ebd39308-d533-4da0-87d0-70b20cd25d28 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:04.479937 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-ebd39308-d533-4da0-87d0-70b20cd25d28 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:04.487563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebd39308-d533-4da0-87d0-70b20cd25d28 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:04.488032 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebd39308-d533-4da0-87d0-70b20cd25d28 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:04.488776 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebd39308-d533-4da0-87d0-70b20cd25d28 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:04.489207 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-ebd39308-d533-4da0-87d0-70b20cd25d28 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:04.620687 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-ebd39308-d533-4da0-87d0-70b20cd25d28 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:04.628113 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-ebd39308-d533-4da0-87d0-70b20cd25d28 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1682 microversion: 2.1 time: 0.153314 Jun 02 16:48:04.628674 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1115/2469] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:04 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:04.925455 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8144f55e-716a-42ee-919a-fdcc811f5394 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:04.931022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8144f55e-716a-42ee-919a-fdcc811f5394 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:04.933225 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8144f55e-716a-42ee-919a-fdcc811f5394 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:04.933678 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8144f55e-716a-42ee-919a-fdcc811f5394 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:04.934506 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8144f55e-716a-42ee-919a-fdcc811f5394 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:04.935052 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8144f55e-716a-42ee-919a-fdcc811f5394 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:05.073284 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8144f55e-716a-42ee-919a-fdcc811f5394 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:05.080952 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8144f55e-716a-42ee-919a-fdcc811f5394 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.159986 Jun 02 16:48:05.081531 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1355/2470] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:04 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:05.645447 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d21d7638-ccf4-4f1e-87a4-8b2009985ee7 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:05.646106 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d21d7638-ccf4-4f1e-87a4-8b2009985ee7 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:05.652657 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d21d7638-ccf4-4f1e-87a4-8b2009985ee7 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:05.653105 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d21d7638-ccf4-4f1e-87a4-8b2009985ee7 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:05.653870 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d21d7638-ccf4-4f1e-87a4-8b2009985ee7 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:05.654368 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d21d7638-ccf4-4f1e-87a4-8b2009985ee7 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:05.789804 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d21d7638-ccf4-4f1e-87a4-8b2009985ee7 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:05.797439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d21d7638-ccf4-4f1e-87a4-8b2009985ee7 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1682 microversion: 2.1 time: 0.155923 Jun 02 16:48:05.798008 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1116/2471] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:05 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:06.097924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-301cf5a9-b737-4d96-a123-04a347cea3b6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:06.098605 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-301cf5a9-b737-4d96-a123-04a347cea3b6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:06.104893 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-301cf5a9-b737-4d96-a123-04a347cea3b6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:06.105335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-301cf5a9-b737-4d96-a123-04a347cea3b6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:06.106098 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-301cf5a9-b737-4d96-a123-04a347cea3b6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:06.106533 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-301cf5a9-b737-4d96-a123-04a347cea3b6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:06.240177 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-301cf5a9-b737-4d96-a123-04a347cea3b6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:06.247901 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-301cf5a9-b737-4d96-a123-04a347cea3b6 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.153692 Jun 02 16:48:06.249144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1356/2472] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:06 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:06.814531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-902ffb2f-1a4d-4e1b-8200-eba85276e5a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:06.815073 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-902ffb2f-1a4d-4e1b-8200-eba85276e5a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:06.821498 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-902ffb2f-1a4d-4e1b-8200-eba85276e5a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:06.821942 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-902ffb2f-1a4d-4e1b-8200-eba85276e5a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:06.822734 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-902ffb2f-1a4d-4e1b-8200-eba85276e5a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:06.823169 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-902ffb2f-1a4d-4e1b-8200-eba85276e5a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:06.950433 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-902ffb2f-1a4d-4e1b-8200-eba85276e5a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:06.957774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-902ffb2f-1a4d-4e1b-8200-eba85276e5a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1682 microversion: 2.1 time: 0.147267 Jun 02 16:48:06.958346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1117/2473] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:06 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:07.266801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8de245a6-da5b-414c-a83b-d035f8263bc5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:07.267522 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8de245a6-da5b-414c-a83b-d035f8263bc5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:07.273884 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8de245a6-da5b-414c-a83b-d035f8263bc5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:07.274358 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8de245a6-da5b-414c-a83b-d035f8263bc5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:07.275115 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8de245a6-da5b-414c-a83b-d035f8263bc5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:07.275548 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8de245a6-da5b-414c-a83b-d035f8263bc5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:07.407429 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8de245a6-da5b-414c-a83b-d035f8263bc5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:07.414680 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8de245a6-da5b-414c-a83b-d035f8263bc5 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.152840 Jun 02 16:48:07.415230 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1357/2474] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:07 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:07.983342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-bbc5425e-96e6-4828-a438-4512a7b80e31 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:07.983969 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-bbc5425e-96e6-4828-a438-4512a7b80e31 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:07.990608 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bbc5425e-96e6-4828-a438-4512a7b80e31 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:07.991056 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bbc5425e-96e6-4828-a438-4512a7b80e31 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:07.991824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bbc5425e-96e6-4828-a438-4512a7b80e31 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:07.992525 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-bbc5425e-96e6-4828-a438-4512a7b80e31 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:08.124334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-bbc5425e-96e6-4828-a438-4512a7b80e31 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:08.131746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-bbc5425e-96e6-4828-a438-4512a7b80e31 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1682 microversion: 2.1 time: 0.152460 Jun 02 16:48:08.132314 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1118/2475] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:07 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:48:08.431726 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d665b44a-9338-4d2b-bd49-0a105525b782 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:08.432341 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d665b44a-9338-4d2b-bd49-0a105525b782 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:08.439896 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d665b44a-9338-4d2b-bd49-0a105525b782 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:08.440347 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d665b44a-9338-4d2b-bd49-0a105525b782 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:08.441109 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d665b44a-9338-4d2b-bd49-0a105525b782 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:08.441544 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d665b44a-9338-4d2b-bd49-0a105525b782 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:08.578708 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d665b44a-9338-4d2b-bd49-0a105525b782 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:08.583178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:08.588090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d665b44a-9338-4d2b-bd49-0a105525b782 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.160314 Jun 02 16:48:08.588784 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1358/2476] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:08 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:09.149052 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-a42babd9-008f-42bc-80fb-299c002255b2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:09.149654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-a42babd9-008f-42bc-80fb-299c002255b2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:09.156275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a42babd9-008f-42bc-80fb-299c002255b2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:09.156726 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a42babd9-008f-42bc-80fb-299c002255b2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:09.157491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a42babd9-008f-42bc-80fb-299c002255b2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:09.157928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-a42babd9-008f-42bc-80fb-299c002255b2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:09.353275 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-a42babd9-008f-42bc-80fb-299c002255b2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:09.361609 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-a42babd9-008f-42bc-80fb-299c002255b2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1682 microversion: 2.1 time: 0.216397 Jun 02 16:48:09.362259 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1119/2477] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:09 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:09.606134 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ebd6293d-1f25-4d87-818e-24a141173971 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:09.606778 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ebd6293d-1f25-4d87-818e-24a141173971 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:09.616205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ebd6293d-1f25-4d87-818e-24a141173971 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:09.616911 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ebd6293d-1f25-4d87-818e-24a141173971 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:09.617943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ebd6293d-1f25-4d87-818e-24a141173971 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:09.618406 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ebd6293d-1f25-4d87-818e-24a141173971 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:09.732421 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-e19016a5-f6d7-4e72-8fc7-80c52701202c req-8aa2c114-df41-4cf6-a18f-aa0a1393ec60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b7400e-e5fc-4ff4-a448-9922a5d2855f", "name": "network-vif-deleted", "tag": "23972d6f-13d5-47db-9262-4bd640932d4d"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:09.741594 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e19016a5-f6d7-4e72-8fc7-80c52701202c req-8aa2c114-df41-4cf6-a18f-aa0a1393ec60 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:09.742334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-e19016a5-f6d7-4e72-8fc7-80c52701202c req-8aa2c114-df41-4cf6-a18f-aa0a1393ec60 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:09.753530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-e19016a5-f6d7-4e72-8fc7-80c52701202c req-8aa2c114-df41-4cf6-a18f-aa0a1393ec60 service nova] Creating event network-vif-deleted:23972d6f-13d5-47db-9262-4bd640932d4d for instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f on hv-cinder-79760 Jun 02 16:48:09.757087 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR oslo.messaging._drivers.impl_rabbit [req-e19016a5-f6d7-4e72-8fc7-80c52701202c req-8aa2c114-df41-4cf6-a18f-aa0a1393ec60 service nova] [c67c0555-f796-4fda-a481-7c573bc045eb] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 16:48:09.762957 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ebd6293d-1f25-4d87-818e-24a141173971 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:09.770621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ebd6293d-1f25-4d87-818e-24a141173971 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.168422 Jun 02 16:48:09.771265 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1359/2478] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:09 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:10.665657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-088b5d5c-6b38-4ae4-a9ce-2915974c48d2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:10.665657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-088b5d5c-6b38-4ae4-a9ce-2915974c48d2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:10.665657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-088b5d5c-6b38-4ae4-a9ce-2915974c48d2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:10.665657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-088b5d5c-6b38-4ae4-a9ce-2915974c48d2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:10.667343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-088b5d5c-6b38-4ae4-a9ce-2915974c48d2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:10.667343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-088b5d5c-6b38-4ae4-a9ce-2915974c48d2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:10.667343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-088b5d5c-6b38-4ae4-a9ce-2915974c48d2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:10.668692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-088b5d5c-6b38-4ae4-a9ce-2915974c48d2 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1326 microversion: 2.1 time: 0.094828 Jun 02 16:48:10.668692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1360/2479] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:10 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:10.668692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-ba7ee31f-1d76-4790-b5dd-c4c080d46dfb req-a05413ed-336f-4447-be0b-c6ad55e36ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541603d2-303b-40d4-b62f-e93198338893", "name": "network-vif-plugged", "status": "completed", "tag": "7faeeaff-0468-43f6-80ee-8d6375195eb2"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:10.668692 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-ba7ee31f-1d76-4790-b5dd-c4c080d46dfb req-a05413ed-336f-4447-be0b-c6ad55e36ce6 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:10.669456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-ba7ee31f-1d76-4790-b5dd-c4c080d46dfb req-a05413ed-336f-4447-be0b-c6ad55e36ce6 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:10.669456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-ba7ee31f-1d76-4790-b5dd-c4c080d46dfb req-a05413ed-336f-4447-be0b-c6ad55e36ce6 service nova] Creating event network-vif-plugged:7faeeaff-0468-43f6-80ee-8d6375195eb2 for instance 541603d2-303b-40d4-b62f-e93198338893 on hv-cinder-79760 Jun 02 16:48:10.669456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-ba7ee31f-1d76-4790-b5dd-c4c080d46dfb req-a05413ed-336f-4447-be0b-c6ad55e36ce6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173954 Jun 02 16:48:10.669456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1361/2480] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:48:10.766192 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [req-e19016a5-f6d7-4e72-8fc7-80c52701202c req-8aa2c114-df41-4cf6-a18f-aa0a1393ec60 service nova] [c67c0555-f796-4fda-a481-7c573bc045eb] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58004. Jun 02 16:48:10.770098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-e19016a5-f6d7-4e72-8fc7-80c52701202c req-8aa2c114-df41-4cf6-a18f-aa0a1393ec60 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.041544 Jun 02 16:48:10.770982 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1120/2481] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:48:10.788116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2962ab4b-360e-43a9-a310-46a67a460092 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:10.788818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2962ab4b-360e-43a9-a310-46a67a460092 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:10.795216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2962ab4b-360e-43a9-a310-46a67a460092 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:10.796420 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2962ab4b-360e-43a9-a310-46a67a460092 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:10.797239 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2962ab4b-360e-43a9-a310-46a67a460092 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:10.797681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2962ab4b-360e-43a9-a310-46a67a460092 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:10.937552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2962ab4b-360e-43a9-a310-46a67a460092 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:10.946194 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2962ab4b-360e-43a9-a310-46a67a460092 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.162366 Jun 02 16:48:10.946800 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1362/2482] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:10 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 16:48:11.489904 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:11.490633 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:11.497177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:11.497624 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:11.498418 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:11.499496 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:11.531393 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:11.531914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:11.532284 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lazy-loading 'fault' on Instance uuid 20b7400e-e5fc-4ff4-a448-9922a5d2855f {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:48:11.577114 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:11.584824 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d3b1dbcc-f450-4fbd-a3c3-ef52d71c2ef3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 200 len: 1331 microversion: 2.1 time: 0.099587 Jun 02 16:48:11.585404 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1121/2483] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:11 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:11.964435 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e5abe81a-4272-4229-b457-c6a9548b5a89 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:11.966102 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e5abe81a-4272-4229-b457-c6a9548b5a89 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:11.972942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5abe81a-4272-4229-b457-c6a9548b5a89 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:11.973394 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5abe81a-4272-4229-b457-c6a9548b5a89 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:11.974189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5abe81a-4272-4229-b457-c6a9548b5a89 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:11.974657 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e5abe81a-4272-4229-b457-c6a9548b5a89 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:12.104812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e5abe81a-4272-4229-b457-c6a9548b5a89 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:12.113202 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e5abe81a-4272-4229-b457-c6a9548b5a89 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.152655 Jun 02 16:48:12.113767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1363/2484] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:11 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:12.422551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:48:12.422713 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:48:12.601922 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:12.602563 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:12.609420 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:12.609896 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:12.610683 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:12.611119 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:12.615255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=100 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:12.625252 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f HTTP/1.1 Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:48:12.626877 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:48:12.631488 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '20b7400e-e5fc-4ff4-a448-9922a5d2855f'} Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:48:12.632258 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:48:12.633307 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:48:12.634427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 404 to user: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:48:12.634427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b3011eee-ff71-42c4-b274-196dc83f2fdc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 404 len: 111 microversion: 2.1 time: 0.030193 Jun 02 16:48:12.634427 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1122/2485] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:12 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:48:12.636960 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-93383f86-3b5c-4084-8dfc-5fff45ee9a5d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '.version_select at 0x7f2d60b8e160>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:12.705594 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-93383f86-3b5c-4084-8dfc-5fff45ee9a5d tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828339456" status: 202 len: 0 microversion: 2.1 time: 0.072309 Jun 02 16:48:12.706330 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1364/2486] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Jun 2 16:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828339456 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:48:13.132107 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d5cac12b-1c46-4ba5-adbc-946a574f0eb4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:13.132760 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d5cac12b-1c46-4ba5-adbc-946a574f0eb4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:13.139257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5cac12b-1c46-4ba5-adbc-946a574f0eb4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:13.139711 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5cac12b-1c46-4ba5-adbc-946a574f0eb4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:13.140511 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5cac12b-1c46-4ba5-adbc-946a574f0eb4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:13.140910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d5cac12b-1c46-4ba5-adbc-946a574f0eb4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:13.279482 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-d5cac12b-1c46-4ba5-adbc-946a574f0eb4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:13.288218 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d5cac12b-1c46-4ba5-adbc-946a574f0eb4 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1318 microversion: 2.1 time: 0.160696 Jun 02 16:48:13.288791 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1123/2487] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:13 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:13.493658 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-7abba4d8-f5d5-405e-9bc1-3f0dc661cd2e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Action: 'create', calling method: .version_select at 0x7f2d60bc7700>, body: {"keypair": {"name": "tempest-keypair-1159221733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgpPWdRGVVwF9gUVmO8I7ECkERTHYf84xKES/8VEmbQS5Nfe1e+f7U5na13GqLXhbE85zkXPaN0rWBPs2KDbaMC5DmHLXQVcowRRNgBbrgK3cfRMc6jRR45CkdUy6yAZA=="}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:13.508427 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-7abba4d8-f5d5-405e-9bc1-3f0dc661cd2e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for project 17568d6be8f640359bd4c6ec666ea168. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:48:13.512280 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.quota [None req-7abba4d8-f5d5-405e-9bc1-3f0dc661cd2e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for user f8503989cb4a4d9c8db260b403e07226 and project 17568d6be8f640359bd4c6ec666ea168. Resources: {'key_pairs'} {{(pid=118256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:48:13.596812 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-7abba4d8-f5d5-405e-9bc1-3f0dc661cd2e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107770 Jun 02 16:48:13.597437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1365/2488] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jun 2 16:48:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:48:14.306999 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8a90252d-2717-4bbd-9b77-083ce272045e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:14.308429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8a90252d-2717-4bbd-9b77-083ce272045e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:14.317177 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a90252d-2717-4bbd-9b77-083ce272045e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:14.317694 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a90252d-2717-4bbd-9b77-083ce272045e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:14.318716 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a90252d-2717-4bbd-9b77-083ce272045e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:14.319303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8a90252d-2717-4bbd-9b77-083ce272045e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:14.463246 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8a90252d-2717-4bbd-9b77-083ce272045e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:14.471116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8a90252d-2717-4bbd-9b77-083ce272045e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1507 microversion: 2.1 time: 0.168406 Jun 02 16:48:14.471693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1124/2489] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:14 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:14.492621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-68942399-0cdd-4134-a944-337bd7e4fd1f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9583e32a-6e65-4167-a315-90486a7abc97", "device": "/dev/sdb"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:14.492621 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-68942399-0cdd-4134-a944-337bd7e4fd1f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:14.498566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68942399-0cdd-4134-a944-337bd7e4fd1f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:14.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68942399-0cdd-4134-a944-337bd7e4fd1f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:14.500421 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68942399-0cdd-4134-a944-337bd7e4fd1f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:14.500854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-68942399-0cdd-4134-a944-337bd7e4fd1f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:15.279280 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-68942399-0cdd-4134-a944-337bd7e4fd1f tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "POST /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.793422 Jun 02 16:48:15.279900 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1366/2490] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:48:14 2022] POST /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:48:15.942537 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-502766695", "imageRef": "95c7720c-2dd1-4619-98b8-91b44bb1a67a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c27844a7-dad1-4504-8943-6ba2accd51fc"}], "security_groups": [{"name": "tempest-securitygroup--1192245285"}], "key_name": "tempest-keypair-1159221733", "user_data": "}} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:16.043732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.network.neutron [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] validate_networks() for [('c27844a7-dad1-4504-8943-6ba2accd51fc', None, None, None, None, None)] {{(pid=118257) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 16:48:16.424428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Flavor limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 16:48:16.426157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Image limits 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 16:48:16.426157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Flavor pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 16:48:16.426157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Image pref 0:0:0 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 16:48:16.426157 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.virt.hardware [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 16:48:16.435151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:16.435599 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:16.436654 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:16.437098 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:16.453698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for project 17568d6be8f640359bd4c6ec666ea168. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 16:48:16.457671 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.quota [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Getting quotas for user f8503989cb4a4d9c8db260b403e07226 and project 17568d6be8f640359bd4c6ec666ea168. Resources: {'ram', 'instances', 'cores'} {{(pid=118257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 16:48:16.469152 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Going to run 1 instances... {{(pid=118257) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 16:48:16.471432 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95c7720c-2dd1-4619-98b8-91b44bb1a67a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 16:48:16.585372 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-0bab4bd8-a9fb-41ea-ac1e-ac742764d930 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647178 Jun 02 16:48:16.585950 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1125/2491] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jun 2 16:48:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 16:48:16.597071 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4ba3d8e3-a771-4b22-abf1-15b53c036c9a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:16.597761 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4ba3d8e3-a771-4b22-abf1-15b53c036c9a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:16.652929 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4ba3d8e3-a771-4b22-abf1-15b53c036c9a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:16.660231 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4ba3d8e3-a771-4b22-abf1-15b53c036c9a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1241 microversion: 2.1 time: 0.068031 Jun 02 16:48:16.660835 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1367/2492] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:16 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:17.678014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-1c86ef97-66a7-4da9-bb61-2fa5c806d697 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:17.678663 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-1c86ef97-66a7-4da9-bb61-2fa5c806d697 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:17.733505 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-1c86ef97-66a7-4da9-bb61-2fa5c806d697 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:17.740379 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-1c86ef97-66a7-4da9-bb61-2fa5c806d697 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1241 microversion: 2.1 time: 0.066834 Jun 02 16:48:17.741850 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1126/2493] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:17 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:18.759950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d355c685-7008-4cb7-81b0-f51333e46bb5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:18.759950 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d355c685-7008-4cb7-81b0-f51333e46bb5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:18.761154 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:18.813666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d355c685-7008-4cb7-81b0-f51333e46bb5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:18.820609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d355c685-7008-4cb7-81b0-f51333e46bb5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1241 microversion: 2.1 time: 0.067621 Jun 02 16:48:18.821193 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1368/2494] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:18 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:19.836451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-012a7ca0-2195-447b-a8d2-bf50b51a2578 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:19.837067 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-012a7ca0-2195-447b-a8d2-bf50b51a2578 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:19.890224 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-012a7ca0-2195-447b-a8d2-bf50b51a2578 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:19.896822 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-012a7ca0-2195-447b-a8d2-bf50b51a2578 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1241 microversion: 2.1 time: 0.064167 Jun 02 16:48:19.897386 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1127/2495] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:19 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:20.130050 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:48:20.130236 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:48:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:48:20.913659 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-a102177f-1bbd-45a0-aa73-546dbc7d5b43 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:20.914241 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-a102177f-1bbd-45a0-aa73-546dbc7d5b43 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:20.921413 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a102177f-1bbd-45a0-aa73-546dbc7d5b43 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:20.921861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a102177f-1bbd-45a0-aa73-546dbc7d5b43 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:20.922648 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a102177f-1bbd-45a0-aa73-546dbc7d5b43 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:20.923745 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-a102177f-1bbd-45a0-aa73-546dbc7d5b43 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:20.988709 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-a102177f-1bbd-45a0-aa73-546dbc7d5b43 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:20.996579 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-a102177f-1bbd-45a0-aa73-546dbc7d5b43 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1245 microversion: 2.1 time: 0.086895 Jun 02 16:48:20.997159 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1369/2496] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:20 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:22.013661 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-f08388ed-bed4-4027-874e-c1769ece19e0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:22.014335 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-f08388ed-bed4-4027-874e-c1769ece19e0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:22.021860 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f08388ed-bed4-4027-874e-c1769ece19e0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:22.022348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f08388ed-bed4-4027-874e-c1769ece19e0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:22.023115 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f08388ed-bed4-4027-874e-c1769ece19e0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:22.023635 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-f08388ed-bed4-4027-874e-c1769ece19e0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:22.086198 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-f08388ed-bed4-4027-874e-c1769ece19e0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:22.093907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-f08388ed-bed4-4027-874e-c1769ece19e0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1245 microversion: 2.1 time: 0.084105 Jun 02 16:48:22.094529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1128/2497] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:22 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:23.110305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-1af8dc94-46cd-4950-8127-5f824c4765a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:23.111671 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-1af8dc94-46cd-4950-8127-5f824c4765a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:23.118354 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1af8dc94-46cd-4950-8127-5f824c4765a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:23.118806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1af8dc94-46cd-4950-8127-5f824c4765a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:23.119559 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1af8dc94-46cd-4950-8127-5f824c4765a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:23.119997 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-1af8dc94-46cd-4950-8127-5f824c4765a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:23.181944 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-1af8dc94-46cd-4950-8127-5f824c4765a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:23.190712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-1af8dc94-46cd-4950-8127-5f824c4765a6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1293 microversion: 2.1 time: 0.083949 Jun 02 16:48:23.191584 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1370/2498] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:23 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:24.208650 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8bb5e889-89c0-42ca-98ba-614520bf13c0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:24.209278 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8bb5e889-89c0-42ca-98ba-614520bf13c0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:24.212494 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:24.215938 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8bb5e889-89c0-42ca-98ba-614520bf13c0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:24.216397 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8bb5e889-89c0-42ca-98ba-614520bf13c0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:24.217170 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8bb5e889-89c0-42ca-98ba-614520bf13c0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:24.217915 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8bb5e889-89c0-42ca-98ba-614520bf13c0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:24.295756 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8bb5e889-89c0-42ca-98ba-614520bf13c0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:24.303457 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8bb5e889-89c0-42ca-98ba-614520bf13c0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1299 microversion: 2.1 time: 0.099199 Jun 02 16:48:24.306835 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1129/2499] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:24 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:25.320475 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d571bd79-0418-4a92-b490-467feda0922b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:25.321116 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d571bd79-0418-4a92-b490-467feda0922b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:25.327617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d571bd79-0418-4a92-b490-467feda0922b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:25.328075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d571bd79-0418-4a92-b490-467feda0922b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:25.328837 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d571bd79-0418-4a92-b490-467feda0922b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:25.329274 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d571bd79-0418-4a92-b490-467feda0922b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:25.465180 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-d571bd79-0418-4a92-b490-467feda0922b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:25.465491 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-643cf34c-d860-40b3-8e8a-7290f101061d req-f5b8c899-6a2a-4e92-b9fd-e3aedd1642b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35830839-10c0-4e8e-ba3e-a161a11c6895", "tag": "8e6bb8e3-5dd9-47c7-8139-02bdd80ebc8b"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:25.467946 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d571bd79-0418-4a92-b490-467feda0922b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.151314 Jun 02 16:48:25.468524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1371/2500] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:25 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:25.483279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-643cf34c-d860-40b3-8e8a-7290f101061d req-f5b8c899-6a2a-4e92-b9fd-e3aedd1642b6 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:25.483684 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-643cf34c-d860-40b3-8e8a-7290f101061d req-f5b8c899-6a2a-4e92-b9fd-e3aedd1642b6 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:25.495774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-643cf34c-d860-40b3-8e8a-7290f101061d req-f5b8c899-6a2a-4e92-b9fd-e3aedd1642b6 service nova] Creating event network-changed:8e6bb8e3-5dd9-47c7-8139-02bdd80ebc8b for instance 35830839-10c0-4e8e-ba3e-a161a11c6895 on hv-cinder-79760 Jun 02 16:48:25.501322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-643cf34c-d860-40b3-8e8a-7290f101061d req-f5b8c899-6a2a-4e92-b9fd-e3aedd1642b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039958 Jun 02 16:48:25.501874 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1130/2501] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:48:26.484666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-ef590796-6b2e-4da9-886e-aacf9fa6079f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:26.485232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-ef590796-6b2e-4da9-886e-aacf9fa6079f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:26.491875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef590796-6b2e-4da9-886e-aacf9fa6079f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:26.492326 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef590796-6b2e-4da9-886e-aacf9fa6079f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:26.493348 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef590796-6b2e-4da9-886e-aacf9fa6079f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:26.493787 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-ef590796-6b2e-4da9-886e-aacf9fa6079f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:26.630878 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-ef590796-6b2e-4da9-886e-aacf9fa6079f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:26.638352 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-ef590796-6b2e-4da9-886e-aacf9fa6079f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.157542 Jun 02 16:48:26.638918 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1372/2502] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:26 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:27.653175 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=2 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:27.658337 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-48835fd2-1a9f-4abb-a777-77616e520fee tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:27.659055 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-48835fd2-1a9f-4abb-a777-77616e520fee tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:27.665276 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48835fd2-1a9f-4abb-a777-77616e520fee tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:27.665733 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48835fd2-1a9f-4abb-a777-77616e520fee tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:27.666530 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48835fd2-1a9f-4abb-a777-77616e520fee tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:27.667014 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-48835fd2-1a9f-4abb-a777-77616e520fee tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:27.800330 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-48835fd2-1a9f-4abb-a777-77616e520fee tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:27.807669 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-48835fd2-1a9f-4abb-a777-77616e520fee tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.155542 Jun 02 16:48:27.808228 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1131/2503] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:27 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:28.825085 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-c36ce8f9-ef34-4c1b-ba36-2e0051f441d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:28.825773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-c36ce8f9-ef34-4c1b-ba36-2e0051f441d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:28.829356 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell0:SELECT=8 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:28.833390 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c36ce8f9-ef34-4c1b-ba36-2e0051f441d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:28.833941 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c36ce8f9-ef34-4c1b-ba36-2e0051f441d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:28.834801 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c36ce8f9-ef34-4c1b-ba36-2e0051f441d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:28.835305 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-c36ce8f9-ef34-4c1b-ba36-2e0051f441d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:28.972749 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-c36ce8f9-ef34-4c1b-ba36-2e0051f441d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:28.980253 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-c36ce8f9-ef34-4c1b-ba36-2e0051f441d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.158995 Jun 02 16:48:28.980748 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1373/2504] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:28 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:29.997450 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8de3c28a-72f1-42f6-8655-05bb00d3fd07 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:29.998099 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8de3c28a-72f1-42f6-8655-05bb00d3fd07 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:30.000371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell0:SELECT=10 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:30.005887 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8de3c28a-72f1-42f6-8655-05bb00d3fd07 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:30.006371 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8de3c28a-72f1-42f6-8655-05bb00d3fd07 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:30.007126 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8de3c28a-72f1-42f6-8655-05bb00d3fd07 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:30.007606 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8de3c28a-72f1-42f6-8655-05bb00d3fd07 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:30.137927 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8de3c28a-72f1-42f6-8655-05bb00d3fd07 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:30.145907 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8de3c28a-72f1-42f6-8655-05bb00d3fd07 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.152680 Jun 02 16:48:30.146503 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1132/2505] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:29 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:31.162545 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-082822e0-2e63-4ff4-8ba2-e89d3bca88a4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:31.163178 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-082822e0-2e63-4ff4-8ba2-e89d3bca88a4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:31.169712 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-082822e0-2e63-4ff4-8ba2-e89d3bca88a4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:31.170205 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-082822e0-2e63-4ff4-8ba2-e89d3bca88a4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:31.171014 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-082822e0-2e63-4ff4-8ba2-e89d3bca88a4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:31.171456 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-082822e0-2e63-4ff4-8ba2-e89d3bca88a4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:31.310951 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-082822e0-2e63-4ff4-8ba2-e89d3bca88a4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:31.318450 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-082822e0-2e63-4ff4-8ba2-e89d3bca88a4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.159680 Jun 02 16:48:31.319026 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1374/2506] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:31 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:32.335820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-28ad906e-4f7e-48b0-b45f-5ccafe5864d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:32.336349 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-28ad906e-4f7e-48b0-b45f-5ccafe5864d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:32.342774 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28ad906e-4f7e-48b0-b45f-5ccafe5864d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:32.343242 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28ad906e-4f7e-48b0-b45f-5ccafe5864d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:32.343991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28ad906e-4f7e-48b0-b45f-5ccafe5864d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:32.344425 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-28ad906e-4f7e-48b0-b45f-5ccafe5864d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:32.471346 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-28ad906e-4f7e-48b0-b45f-5ccafe5864d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:32.478830 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-28ad906e-4f7e-48b0-b45f-5ccafe5864d0 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.147691 Jun 02 16:48:32.479387 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1133/2507] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:32 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:33.497075 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-21e14fc2-76f3-45ef-a6e5-bc7272a30f6b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:33.497681 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-21e14fc2-76f3-45ef-a6e5-bc7272a30f6b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:33.504641 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21e14fc2-76f3-45ef-a6e5-bc7272a30f6b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:33.505083 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21e14fc2-76f3-45ef-a6e5-bc7272a30f6b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:33.505830 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21e14fc2-76f3-45ef-a6e5-bc7272a30f6b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:33.506299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-21e14fc2-76f3-45ef-a6e5-bc7272a30f6b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:33.632866 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-21e14fc2-76f3-45ef-a6e5-bc7272a30f6b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:33.640144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-21e14fc2-76f3-45ef-a6e5-bc7272a30f6b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.147164 Jun 02 16:48:33.640702 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1375/2508] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:33 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:34.657209 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e426fa8d-708a-4dd2-ab56-d18c1229895e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:34.657818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e426fa8d-708a-4dd2-ab56-d18c1229895e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:34.665336 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e426fa8d-708a-4dd2-ab56-d18c1229895e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:34.665789 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e426fa8d-708a-4dd2-ab56-d18c1229895e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:34.666590 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e426fa8d-708a-4dd2-ab56-d18c1229895e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:34.667034 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e426fa8d-708a-4dd2-ab56-d18c1229895e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:34.798289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e426fa8d-708a-4dd2-ab56-d18c1229895e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:34.805578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e426fa8d-708a-4dd2-ab56-d18c1229895e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.152185 Jun 02 16:48:34.806146 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1134/2509] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:34 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:35.821818 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8ab453bb-f06e-4276-8b83-64dd864839e6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:35.822617 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8ab453bb-f06e-4276-8b83-64dd864839e6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:35.829223 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ab453bb-f06e-4276-8b83-64dd864839e6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:35.829677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ab453bb-f06e-4276-8b83-64dd864839e6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:35.830468 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ab453bb-f06e-4276-8b83-64dd864839e6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:35.830916 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8ab453bb-f06e-4276-8b83-64dd864839e6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:35.961521 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8ab453bb-f06e-4276-8b83-64dd864839e6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:35.969013 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8ab453bb-f06e-4276-8b83-64dd864839e6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.151479 Jun 02 16:48:35.969573 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1376/2510] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:35 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:36.986788 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-07d501c5-a5d2-42ce-9819-7572ba23ff27 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:36.988057 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-07d501c5-a5d2-42ce-9819-7572ba23ff27 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:36.994998 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07d501c5-a5d2-42ce-9819-7572ba23ff27 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:36.995516 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07d501c5-a5d2-42ce-9819-7572ba23ff27 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:36.996279 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07d501c5-a5d2-42ce-9819-7572ba23ff27 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:36.996720 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-07d501c5-a5d2-42ce-9819-7572ba23ff27 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:37.124173 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-07d501c5-a5d2-42ce-9819-7572ba23ff27 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:37.131811 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-07d501c5-a5d2-42ce-9819-7572ba23ff27 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.148876 Jun 02 16:48:37.132384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1135/2511] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:36 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:38.148240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-fe07950e-e171-432a-abee-5f08e94f6807 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:38.148857 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-fe07950e-e171-432a-abee-5f08e94f6807 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:38.155355 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe07950e-e171-432a-abee-5f08e94f6807 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:38.155806 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe07950e-e171-432a-abee-5f08e94f6807 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:38.156566 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe07950e-e171-432a-abee-5f08e94f6807 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:38.157008 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-fe07950e-e171-432a-abee-5f08e94f6807 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:38.289268 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-fe07950e-e171-432a-abee-5f08e94f6807 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:38.296609 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-fe07950e-e171-432a-abee-5f08e94f6807 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.152395 Jun 02 16:48:38.297176 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1377/2512] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:38 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:39.312910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-2b6e5358-8577-48d8-a63c-d307acf3431f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:39.313534 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-2b6e5358-8577-48d8-a63c-d307acf3431f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:39.320840 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b6e5358-8577-48d8-a63c-d307acf3431f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:39.321295 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b6e5358-8577-48d8-a63c-d307acf3431f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:39.322059 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b6e5358-8577-48d8-a63c-d307acf3431f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:39.322523 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-2b6e5358-8577-48d8-a63c-d307acf3431f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:39.451424 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-2b6e5358-8577-48d8-a63c-d307acf3431f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:39.459524 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-2b6e5358-8577-48d8-a63c-d307acf3431f tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.150513 Jun 02 16:48:39.460088 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1136/2513] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:39 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:40.477156 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-e067e606-9e5f-43f9-aaa0-621df7094e88 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:40.477769 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-e067e606-9e5f-43f9-aaa0-621df7094e88 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:40.484487 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e067e606-9e5f-43f9-aaa0-621df7094e88 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:40.484940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e067e606-9e5f-43f9-aaa0-621df7094e88 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:40.485704 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e067e606-9e5f-43f9-aaa0-621df7094e88 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:40.486170 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-e067e606-9e5f-43f9-aaa0-621df7094e88 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:40.491345 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:40.619346 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-e067e606-9e5f-43f9-aaa0-621df7094e88 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:40.626771 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-e067e606-9e5f-43f9-aaa0-621df7094e88 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.153516 Jun 02 16:48:40.627351 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1378/2514] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:40 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:41.644288 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-e452ca85-d687-457f-9458-6c08ac04a8d9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:41.644800 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-e452ca85-d687-457f-9458-6c08ac04a8d9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:41.651255 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e452ca85-d687-457f-9458-6c08ac04a8d9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:41.651698 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e452ca85-d687-457f-9458-6c08ac04a8d9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:41.652451 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e452ca85-d687-457f-9458-6c08ac04a8d9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:41.652881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-e452ca85-d687-457f-9458-6c08ac04a8d9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:42.049204 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-e452ca85-d687-457f-9458-6c08ac04a8d9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:42.057096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-e452ca85-d687-457f-9458-6c08ac04a8d9 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.416703 Jun 02 16:48:42.057668 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1137/2515] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:41 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:43.074629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-4a2e3f99-c02e-4768-8d7a-ea4ab79c89c5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:43.075302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-4a2e3f99-c02e-4768-8d7a-ea4ab79c89c5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:43.082108 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a2e3f99-c02e-4768-8d7a-ea4ab79c89c5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:43.082554 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a2e3f99-c02e-4768-8d7a-ea4ab79c89c5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:43.083504 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a2e3f99-c02e-4768-8d7a-ea4ab79c89c5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:43.083940 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-4a2e3f99-c02e-4768-8d7a-ea4ab79c89c5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:43.460547 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-4a2e3f99-c02e-4768-8d7a-ea4ab79c89c5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:43.467931 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-4a2e3f99-c02e-4768-8d7a-ea4ab79c89c5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.397718 Jun 02 16:48:43.468503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1379/2516] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:43 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:44.484303 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-87f671e7-84d7-4eac-9d5b-72a97dc24519 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:44.484920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-87f671e7-84d7-4eac-9d5b-72a97dc24519 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:44.492138 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87f671e7-84d7-4eac-9d5b-72a97dc24519 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:44.492584 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87f671e7-84d7-4eac-9d5b-72a97dc24519 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:44.493348 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87f671e7-84d7-4eac-9d5b-72a97dc24519 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:44.494053 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-87f671e7-84d7-4eac-9d5b-72a97dc24519 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:44.497905 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=71 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:44.625484 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-87f671e7-84d7-4eac-9d5b-72a97dc24519 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:44.632753 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-87f671e7-84d7-4eac-9d5b-72a97dc24519 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.152348 Jun 02 16:48:44.633315 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1138/2517] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:44 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:45.459363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-14926740-6bd2-4275-a20f-43f08dd5e041 req-2b2151d1-95da-422a-941e-a93bcb384181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35830839-10c0-4e8e-ba3e-a161a11c6895", "name": "network-vif-plugged", "status": "completed", "tag": "8e6bb8e3-5dd9-47c7-8139-02bdd80ebc8b"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:45.468631 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-14926740-6bd2-4275-a20f-43f08dd5e041 req-2b2151d1-95da-422a-941e-a93bcb384181 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:45.469076 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-14926740-6bd2-4275-a20f-43f08dd5e041 req-2b2151d1-95da-422a-941e-a93bcb384181 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:45.480203 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-14926740-6bd2-4275-a20f-43f08dd5e041 req-2b2151d1-95da-422a-941e-a93bcb384181 service nova] Creating event network-vif-plugged:8e6bb8e3-5dd9-47c7-8139-02bdd80ebc8b for instance 35830839-10c0-4e8e-ba3e-a161a11c6895 on hv-cinder-79760 Jun 02 16:48:45.485459 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-14926740-6bd2-4275-a20f-43f08dd5e041 req-2b2151d1-95da-422a-941e-a93bcb384181 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031330 Jun 02 16:48:45.486357 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1380/2518] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:48:45.648991 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-130dcd43-d10e-4440-835c-63a52de3dbcc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:45.649613 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-130dcd43-d10e-4440-835c-63a52de3dbcc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:45.656143 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-130dcd43-d10e-4440-835c-63a52de3dbcc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:45.656595 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-130dcd43-d10e-4440-835c-63a52de3dbcc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:45.657528 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-130dcd43-d10e-4440-835c-63a52de3dbcc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:45.657975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-130dcd43-d10e-4440-835c-63a52de3dbcc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:45.818664 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-130dcd43-d10e-4440-835c-63a52de3dbcc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:45.826653 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-130dcd43-d10e-4440-835c-63a52de3dbcc tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.181820 Jun 02 16:48:45.827400 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1139/2519] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:45 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:46.844707 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-9c6a3a40-6e44-493e-b7e7-58bf63a7cff8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:46.845440 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-9c6a3a40-6e44-493e-b7e7-58bf63a7cff8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:46.852530 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c6a3a40-6e44-493e-b7e7-58bf63a7cff8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:46.852942 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c6a3a40-6e44-493e-b7e7-58bf63a7cff8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:46.853694 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c6a3a40-6e44-493e-b7e7-58bf63a7cff8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:46.854237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-9c6a3a40-6e44-493e-b7e7-58bf63a7cff8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:46.987932 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-9c6a3a40-6e44-493e-b7e7-58bf63a7cff8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:46.996363 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-9c6a3a40-6e44-493e-b7e7-58bf63a7cff8 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.156117 Jun 02 16:48:46.996926 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1381/2520] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:46 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:48.013222 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-54e13d24-5568-4d15-b369-a8233b01a38b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:48.014342 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-54e13d24-5568-4d15-b369-a8233b01a38b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:48.029459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-54e13d24-5568-4d15-b369-a8233b01a38b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:48.029459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-54e13d24-5568-4d15-b369-a8233b01a38b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:48.029459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-54e13d24-5568-4d15-b369-a8233b01a38b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:48.029459 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-54e13d24-5568-4d15-b369-a8233b01a38b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:48.165752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-54e13d24-5568-4d15-b369-a8233b01a38b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:48.173969 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-54e13d24-5568-4d15-b369-a8233b01a38b tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1367 microversion: 2.1 time: 0.164501 Jun 02 16:48:48.174625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1140/2521] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:48 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:48.603123 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-dd7a7375-b12d-4acc-8118-1e6437893c0e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:48.603679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-dd7a7375-b12d-4acc-8118-1e6437893c0e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:48.610107 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dd7a7375-b12d-4acc-8118-1e6437893c0e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:48.610572 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dd7a7375-b12d-4acc-8118-1e6437893c0e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:48.611331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dd7a7375-b12d-4acc-8118-1e6437893c0e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:48.611773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-dd7a7375-b12d-4acc-8118-1e6437893c0e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:48.690791 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-dd7a7375-b12d-4acc-8118-1e6437893c0e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lazy-loading 'services' on Instance uuid 541603d2-303b-40d4-b62f-e93198338893 {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:48:48.949130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-dd7a7375-b12d-4acc-8118-1e6437893c0e tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "DELETE /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893/os-volume_attachments/9583e32a-6e65-4167-a315-90486a7abc97" status: 202 len: 0 microversion: 2.1 time: 0.349744 Jun 02 16:48:48.951297 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1382/2522] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:48:48 2022] DELETE /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893/os-volume_attachments/9583e32a-6e65-4167-a315-90486a7abc97 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:48:49.190910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8d93920f-4013-4d20-bf8d-dff59367aae3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:49.191615 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8d93920f-4013-4d20-bf8d-dff59367aae3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:49.199096 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8d93920f-4013-4d20-bf8d-dff59367aae3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:49.199605 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8d93920f-4013-4d20-bf8d-dff59367aae3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:49.200332 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8d93920f-4013-4d20-bf8d-dff59367aae3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:49.200808 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8d93920f-4013-4d20-bf8d-dff59367aae3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:49.331423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8d93920f-4013-4d20-bf8d-dff59367aae3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:49.340216 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8d93920f-4013-4d20-bf8d-dff59367aae3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1557 microversion: 2.1 time: 0.153235 Jun 02 16:48:49.340786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1141/2523] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:49 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:49.357318 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-3ee99ebe-4a5e-4d06-a49d-a61d4c478c8a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:49.362133 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-3ee99ebe-4a5e-4d06-a49d-a61d4c478c8a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:49.364224 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee99ebe-4a5e-4d06-a49d-a61d4c478c8a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:49.364679 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee99ebe-4a5e-4d06-a49d-a61d4c478c8a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:49.365437 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee99ebe-4a5e-4d06-a49d-a61d4c478c8a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:49.365875 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-3ee99ebe-4a5e-4d06-a49d-a61d4c478c8a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:49.450140 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-3ee99ebe-4a5e-4d06-a49d-a61d4c478c8a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096945 Jun 02 16:48:49.450677 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1383/2524] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jun 2 16:48:49 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:48:50.515476 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-4069e08e-d133-470f-b2c8-e8ea67fdd810 req-3ee29cd8-0de7-4d81-bf5f-666eb9563c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35830839-10c0-4e8e-ba3e-a161a11c6895", "tag": "8e6bb8e3-5dd9-47c7-8139-02bdd80ebc8b"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:50.524002 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-4069e08e-d133-470f-b2c8-e8ea67fdd810 req-3ee29cd8-0de7-4d81-bf5f-666eb9563c68 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:50.524714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-4069e08e-d133-470f-b2c8-e8ea67fdd810 req-3ee29cd8-0de7-4d81-bf5f-666eb9563c68 service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:50.536894 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-4069e08e-d133-470f-b2c8-e8ea67fdd810 req-3ee29cd8-0de7-4d81-bf5f-666eb9563c68 service nova] Creating event network-changed:8e6bb8e3-5dd9-47c7-8139-02bdd80ebc8b for instance 35830839-10c0-4e8e-ba3e-a161a11c6895 on hv-cinder-79760 Jun 02 16:48:50.542676 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-4069e08e-d133-470f-b2c8-e8ea67fdd810 req-3ee29cd8-0de7-4d81-bf5f-666eb9563c68 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117418 Jun 02 16:48:50.543289 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1142/2525] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:48:51.130111 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-74b80cbf-6a1e-4987-876a-4cd5c15b383b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:51.131237 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-74b80cbf-6a1e-4987-876a-4cd5c15b383b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:51.135810 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=34 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:51.141366 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74b80cbf-6a1e-4987-876a-4cd5c15b383b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:51.141811 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74b80cbf-6a1e-4987-876a-4cd5c15b383b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:51.142615 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74b80cbf-6a1e-4987-876a-4cd5c15b383b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:51.143221 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-74b80cbf-6a1e-4987-876a-4cd5c15b383b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:51.170770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-74b80cbf-6a1e-4987-876a-4cd5c15b383b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Going to try to terminate instance {{(pid=118256) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:48:51.528666 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-74b80cbf-6a1e-4987-876a-4cd5c15b383b tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "DELETE /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 204 len: 0 microversion: 2.1 time: 0.403058 Jun 02 16:48:51.529491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1384/2526] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:48:51 2022] DELETE /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:48:51.538226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-b525eb36-297c-44ba-b92c-066f6bf68718 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:51.538934 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-b525eb36-297c-44ba-b92c-066f6bf68718 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:51.547512 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b525eb36-297c-44ba-b92c-066f6bf68718 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:51.547970 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b525eb36-297c-44ba-b92c-066f6bf68718 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:51.548746 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b525eb36-297c-44ba-b92c-066f6bf68718 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:51.549187 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-b525eb36-297c-44ba-b92c-066f6bf68718 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:51.687343 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-b525eb36-297c-44ba-b92c-066f6bf68718 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:51.695574 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-b525eb36-297c-44ba-b92c-066f6bf68718 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1513 microversion: 2.1 time: 0.161465 Jun 02 16:48:51.696910 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1143/2527] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:51 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:52.716431 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-887ad120-da78-4771-bece-cf579fb77b70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:52.717089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-887ad120-da78-4771-bece-cf579fb77b70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:52.723597 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-887ad120-da78-4771-bece-cf579fb77b70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:52.724051 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-887ad120-da78-4771-bece-cf579fb77b70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:52.724854 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-887ad120-da78-4771-bece-cf579fb77b70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:52.725296 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-887ad120-da78-4771-bece-cf579fb77b70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:52.858117 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-887ad120-da78-4771-bece-cf579fb77b70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:52.865872 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-887ad120-da78-4771-bece-cf579fb77b70 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1513 microversion: 2.1 time: 0.153704 Jun 02 16:48:52.866465 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1385/2528] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:52 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:53.884206 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-4487f31e-cb79-4209-9ee8-5a127ae5dd34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:53.885151 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-4487f31e-cb79-4209-9ee8-5a127ae5dd34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:53.891839 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4487f31e-cb79-4209-9ee8-5a127ae5dd34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:53.892288 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4487f31e-cb79-4209-9ee8-5a127ae5dd34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:53.893149 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4487f31e-cb79-4209-9ee8-5a127ae5dd34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:53.893975 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-4487f31e-cb79-4209-9ee8-5a127ae5dd34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:54.113710 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-4487f31e-cb79-4209-9ee8-5a127ae5dd34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:54.122028 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-4487f31e-cb79-4209-9ee8-5a127ae5dd34 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1513 microversion: 2.1 time: 0.241752 Jun 02 16:48:54.122935 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1144/2529] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:53 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:54.347250 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [req-68272d31-a671-4cfb-83f9-91ffeff3b21e req-2c3a9379-a262-477b-acc6-1494e358febb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541603d2-303b-40d4-b62f-e93198338893", "name": "network-vif-deleted", "tag": "7faeeaff-0468-43f6-80ee-8d6375195eb2"}]} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:48:54.355858 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-68272d31-a671-4cfb-83f9-91ffeff3b21e req-2c3a9379-a262-477b-acc6-1494e358febb service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:54.356302 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [req-68272d31-a671-4cfb-83f9-91ffeff3b21e req-2c3a9379-a262-477b-acc6-1494e358febb service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:54.367067 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.compute.server_external_events [req-68272d31-a671-4cfb-83f9-91ffeff3b21e req-2c3a9379-a262-477b-acc6-1494e358febb service nova] Creating event network-vif-deleted:7faeeaff-0468-43f6-80ee-8d6375195eb2 for instance 541603d2-303b-40d4-b62f-e93198338893 on hv-cinder-79760 Jun 02 16:48:54.373046 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [req-68272d31-a671-4cfb-83f9-91ffeff3b21e req-2c3a9379-a262-477b-acc6-1494e358febb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029456 Jun 02 16:48:54.373634 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1386/2530] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:48:55.139862 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:55.141783 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:55.144592 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=32 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:48:55.153019 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:55.153476 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:55.154294 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:55.154738 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:55.188232 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:55.188689 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:55.189150 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lazy-loading 'fault' on Instance uuid 541603d2-303b-40d4-b62f-e93198338893 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:48:55.232191 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2910f2833ce24b17b248ad9106f19786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f556a2c3bb1c45f0a3607912effac5c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:48:55.239854 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-8e48673e-13f6-4493-bcf1-89efcd1eec28 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 200 len: 1308 microversion: 2.1 time: 0.103811 Jun 02 16:48:55.240423 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1145/2531] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:55 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:48:56.257331 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:48:56.258571 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] [instance: 541603d2-303b-40d4-b62f-e93198338893] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:48:56.264805 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:56.265246 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:56.265994 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:48:56.266452 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:48:56.279924 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] HTTP exception thrown: Instance 541603d2-303b-40d4-b62f-e93198338893 could not be found. Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Request method failure captured: Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 HTTP/1.1 Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOIzXG0IbLAQ7CtI-2dW_2PANpK8dCZ603QjCOSjp_gxaJBvdTnGIjVojYhaNPazhUPy_6XKZgWaVz2lWWsAKUnhqYvjgkWOtQaI0_6YYma9gBniuhr7uWLDB7BooG4ngqcoc_QWeDddx7Bak-3uDdTtwK9JlQB9qDZQQMy6zP9E-68 Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:48:56.281510 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f556a2c3bb1c45f0a3607912effac5c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f556a2c3bb1c45f0a3607912effac5c8"}]}] Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: f556a2c3bb1c45f0a3607912effac5c8 Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-177767473 Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: 2910f2833ce24b17b248ad9106f19786 Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-VolumesSnapshotTestJSON-177767473-project Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance 541603d2-303b-40d4-b62f-e93198338893 could not be found. Jun 02 16:48:56.282849 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '541603d2-303b-40d4-b62f-e93198338893'} Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541603d2-303b-40d4-b62f-e93198338893 could not be found. Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:48:56.283603 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541603d2-303b-40d4-b62f-e93198338893 could not be found. Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541603d2-303b-40d4-b62f-e93198338893 could not be found. Jun 02 16:48:56.284825 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:48:56.285906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] Returning 404 to user: Instance 541603d2-303b-40d4-b62f-e93198338893 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:48:56.285906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f0925291-2cb6-427f-98c0-c2870d69f122 tempest-VolumesSnapshotTestJSON-177767473 tempest-VolumesSnapshotTestJSON-177767473-project] 10.222.0.59 "GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893" status: 404 len: 111 microversion: 2.1 time: 0.030202 Jun 02 16:48:56.285906 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1387/2532] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:48:56 2022] GET /compute/v2.1/servers/541603d2-303b-40d4-b62f-e93198338893 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:49:50.942181 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:49:50.943025 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:50:36.031081 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_api:SELECT=3 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:36.031752 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG dbcounter [-] [118257] Writing DB stats nova_cell1:SELECT=45 {{(pid=118257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:36.035732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d9d68931-156a-4aa1-9954-538983b1203c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:36.036226 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d9d68931-156a-4aa1-9954-538983b1203c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:36.042066 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d9d68931-156a-4aa1-9954-538983b1203c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:36.049154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d9d68931-156a-4aa1-9954-538983b1203c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:36.049154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d9d68931-156a-4aa1-9954-538983b1203c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:36.049154 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d9d68931-156a-4aa1-9954-538983b1203c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:36.067276 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d9d68931-156a-4aa1-9954-538983b1203c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/ips" status: 200 len: 150 microversion: 2.1 time: 0.038027 Jun 02 16:50:36.067827 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1146/2533] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jun 2 16:50:36 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:50:37.608767 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:37.609508 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG dbcounter [-] [118256] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:50:37.613552 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-530aa77c-0120-4f48-b55a-35b5b0475551 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df1b33c-3423-43b2-a83a-e56b024e365d"}} {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:50:37.614629 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-530aa77c-0120-4f48-b55a-35b5b0475551 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:37.620474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-530aa77c-0120-4f48-b55a-35b5b0475551 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:37.620919 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-530aa77c-0120-4f48-b55a-35b5b0475551 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:37.621667 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-530aa77c-0120-4f48-b55a-35b5b0475551 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:37.622130 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-530aa77c-0120-4f48-b55a-35b5b0475551 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:38.372233 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-530aa77c-0120-4f48-b55a-35b5b0475551 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "POST /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765029 Jun 02 16:50:38.373336 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1388/2534] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jun 2 16:50:37 2022] POST /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments => generated 194 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:50:47.155462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-3b187989-663c-4f90-9710-dc858b3bdf50 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:47.168754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-3b187989-663c-4f90-9710-dc858b3bdf50 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:47.168754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3b187989-663c-4f90-9710-dc858b3bdf50 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:47.168754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3b187989-663c-4f90-9710-dc858b3bdf50 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:47.168754 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3b187989-663c-4f90-9710-dc858b3bdf50 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:47.169084 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-3b187989-663c-4f90-9710-dc858b3bdf50 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:47.246244 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.objects.instance [None req-3b187989-663c-4f90-9710-dc858b3bdf50 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lazy-loading 'services' on Instance uuid 35830839-10c0-4e8e-ba3e-a161a11c6895 {{(pid=118257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:50:47.497118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-3b187989-663c-4f90-9710-dc858b3bdf50 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments/8df1b33c-3423-43b2-a83a-e56b024e365d" status: 202 len: 0 microversion: 2.1 time: 0.345847 Jun 02 16:50:47.497703 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1147/2535] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jun 2 16:50:47 2022] DELETE /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments/8df1b33c-3423-43b2-a83a-e56b024e365d => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:50:47.507570 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f5d1bf5f-5979-43e3-ba68-ad89cacaa912 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:47.508715 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f5d1bf5f-5979-43e3-ba68-ad89cacaa912 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:47.515526 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5d1bf5f-5979-43e3-ba68-ad89cacaa912 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:47.525770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5d1bf5f-5979-43e3-ba68-ad89cacaa912 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:47.525770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5d1bf5f-5979-43e3-ba68-ad89cacaa912 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:47.525770 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f5d1bf5f-5979-43e3-ba68-ad89cacaa912 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:47.547309 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f5d1bf5f-5979-43e3-ba68-ad89cacaa912 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044779 Jun 02 16:50:47.547861 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1389/2536] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:50:47 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:50:48.560855 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-c636ac15-3b55-4c41-83bb-225dee663e66 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:48.561867 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-c636ac15-3b55-4c41-83bb-225dee663e66 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:48.569158 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c636ac15-3b55-4c41-83bb-225dee663e66 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:48.569610 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c636ac15-3b55-4c41-83bb-225dee663e66 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:48.570428 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c636ac15-3b55-4c41-83bb-225dee663e66 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:48.570864 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-c636ac15-3b55-4c41-83bb-225dee663e66 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:48.599732 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-c636ac15-3b55-4c41-83bb-225dee663e66 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Jun 02 16:50:48.600407 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1148/2537] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:50:48 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 16:50:49.611273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-d3396d0e-5f19-497e-a82d-b68b26a095a3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:49.612240 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-d3396d0e-5f19-497e-a82d-b68b26a095a3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:49.618836 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d3396d0e-5f19-497e-a82d-b68b26a095a3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:49.619289 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d3396d0e-5f19-497e-a82d-b68b26a095a3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:49.620050 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d3396d0e-5f19-497e-a82d-b68b26a095a3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:49.620486 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-d3396d0e-5f19-497e-a82d-b68b26a095a3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:49.648731 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-d3396d0e-5f19-497e-a82d-b68b26a095a3 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041416 Jun 02 16:50:49.649273 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1390/2538] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jun 2 16:50:49 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 16:50:49.705652 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-d33d3f4f-bbe9-4c63-9fe9-720f17f57b3a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:49.706836 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d33d3f4f-bbe9-4c63-9fe9-720f17f57b3a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:49.713463 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d33d3f4f-bbe9-4c63-9fe9-720f17f57b3a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:49.713914 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d33d3f4f-bbe9-4c63-9fe9-720f17f57b3a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:49.714820 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d33d3f4f-bbe9-4c63-9fe9-720f17f57b3a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:49.715261 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-d33d3f4f-bbe9-4c63-9fe9-720f17f57b3a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:49.739740 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-d33d3f4f-bbe9-4c63-9fe9-720f17f57b3a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Going to try to terminate instance {{(pid=118257) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 16:50:50.067195 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-d33d3f4f-bbe9-4c63-9fe9-720f17f57b3a tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 204 len: 0 microversion: 2.1 time: 0.364954 Jun 02 16:50:50.067714 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1149/2539] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:50:49 2022] DELETE /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 16:50:50.075588 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-8371ca86-711f-40ad-b100-901a292953dd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:50.085090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-8371ca86-711f-40ad-b100-901a292953dd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:50.085090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8371ca86-711f-40ad-b100-901a292953dd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:50.085090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8371ca86-711f-40ad-b100-901a292953dd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:50.085090 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8371ca86-711f-40ad-b100-901a292953dd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:50.085416 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-8371ca86-711f-40ad-b100-901a292953dd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:50.216419 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-8371ca86-711f-40ad-b100-901a292953dd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:50:50.223943 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-8371ca86-711f-40ad-b100-901a292953dd tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1682 microversion: 2.1 time: 0.152039 Jun 02 16:50:50.224496 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1391/2540] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:50:50 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:50:51.241441 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-724ad482-6354-48a2-8904-5720cb23eac6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:51.242199 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-724ad482-6354-48a2-8904-5720cb23eac6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:51.248881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-724ad482-6354-48a2-8904-5720cb23eac6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:51.249334 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-724ad482-6354-48a2-8904-5720cb23eac6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:51.250116 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-724ad482-6354-48a2-8904-5720cb23eac6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:51.250551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-724ad482-6354-48a2-8904-5720cb23eac6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:51.383928 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.policy [None req-724ad482-6354-48a2-8904-5720cb23eac6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118257) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:50:51.391365 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-724ad482-6354-48a2-8904-5720cb23eac6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1682 microversion: 2.1 time: 0.154242 Jun 02 16:50:51.391920 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1150/2541] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:50:51 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:50:52.409219 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-2433f3a9-1ff2-471a-86b6-009aa59d12b5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:52.410451 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-2433f3a9-1ff2-471a-86b6-009aa59d12b5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:52.417144 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2433f3a9-1ff2-471a-86b6-009aa59d12b5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:52.417599 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2433f3a9-1ff2-471a-86b6-009aa59d12b5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:52.418392 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2433f3a9-1ff2-471a-86b6-009aa59d12b5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:52.418833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-2433f3a9-1ff2-471a-86b6-009aa59d12b5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:52.612055 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-2433f3a9-1ff2-471a-86b6-009aa59d12b5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:50:52.620006 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-2433f3a9-1ff2-471a-86b6-009aa59d12b5 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1682 microversion: 2.1 time: 0.214721 Jun 02 16:50:52.620575 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1392/2542] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:50:52 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:50:53.029394 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [req-b772ccd0-cc0e-4dc4-b6d7-bd48af1ab3c2 req-cedf8590-fa07-4ad8-8a13-9548f9fa2aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35830839-10c0-4e8e-ba3e-a161a11c6895", "name": "network-vif-deleted", "tag": "8e6bb8e3-5dd9-47c7-8139-02bdd80ebc8b"}]} {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 16:50:53.038130 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-b772ccd0-cc0e-4dc4-b6d7-bd48af1ab3c2 req-cedf8590-fa07-4ad8-8a13-9548f9fa2aac service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:53.038651 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [req-b772ccd0-cc0e-4dc4-b6d7-bd48af1ab3c2 req-cedf8590-fa07-4ad8-8a13-9548f9fa2aac service nova] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:53.049685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.compute.server_external_events [req-b772ccd0-cc0e-4dc4-b6d7-bd48af1ab3c2 req-cedf8590-fa07-4ad8-8a13-9548f9fa2aac service nova] Creating event network-vif-deleted:8e6bb8e3-5dd9-47c7-8139-02bdd80ebc8b for instance 35830839-10c0-4e8e-ba3e-a161a11c6895 on hv-cinder-79760 Jun 02 16:50:53.055638 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [req-b772ccd0-cc0e-4dc4-b6d7-bd48af1ab3c2 req-cedf8590-fa07-4ad8-8a13-9548f9fa2aac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030132 Jun 02 16:50:53.056322 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1151/2543] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jun 2 16:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 16:50:53.637774 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:53.638408 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:53.644968 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:53.645418 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:53.646214 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:53.646697 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:53.679728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:53.680189 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:53.680642 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.objects.instance [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lazy-loading 'fault' on Instance uuid 35830839-10c0-4e8e-ba3e-a161a11c6895 {{(pid=118256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 16:50:53.722973 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.policy [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8503989cb4a4d9c8db260b403e07226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17568d6be8f640359bd4c6ec666ea168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118256) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 16:50:53.730612 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-f7e5c49a-49da-411d-a482-6e8fb2424dd6 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 200 len: 1331 microversion: 2.1 time: 0.096774 Jun 02 16:50:53.741299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1393/2544] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:50:53 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 16:50:54.750257 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:54.750958 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:54.757321 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:54.757768 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:54.758551 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:54.758986 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:54.772787 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 HTTP/1.1 Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:50:54.774415 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:54.775798 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '35830839-10c0-4e8e-ba3e-a161a11c6895'} Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:50:54.776531 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:54.777693 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:54.778848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 404 to user: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:50:54.778848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-92926f6d-0abf-4dfe-883f-7c3a766fab3e tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 404 len: 111 microversion: 2.1 time: 0.030142 Jun 02 16:50:54.778848 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1152/2545] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:50:54 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:50:54.784343 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-93c7bdce-fb41-4735-9439-e0157a880d2c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '.version_select at 0x7f2d60bba040>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:54.861033 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-93c7bdce-fb41-4735-9439-e0157a880d2c tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159221733" status: 202 len: 0 microversion: 2.1 time: 0.080395 Jun 02 16:50:54.861591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1394/2546] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Jun 2 16:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159221733 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 16:50:56.839245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:56.839747 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:56.846231 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:56.846679 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:56.847439 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:56.847880 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:56.861614 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 HTTP/1.1 Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:50:56.863163 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.864529 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '35830839-10c0-4e8e-ba3e-a161a11c6895'} Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:50:56.865298 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.866292 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.867305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 404 to user: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:50:56.867305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-5cc07f57-bd76-4f74-931a-0207005064da tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 404 len: 111 microversion: 2.1 time: 0.029258 Jun 02 16:50:56.867305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1153/2547] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:50:56 2022] DELETE /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:50:56.873335 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:56.874232 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 35830839-10c0-4e8e-ba3e-a161a11c6895] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:56.880833 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:56.881282 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:56.882034 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:56.882503 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:56.895759 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 HTTP/1.1 Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:50:56.897375 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.898689 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '35830839-10c0-4e8e-ba3e-a161a11c6895'} Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:50:56.899398 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. Jun 02 16:50:56.900551 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:56.901591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 404 to user: Instance 35830839-10c0-4e8e-ba3e-a161a11c6895 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:50:56.901591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-23b5ca16-2126-4742-b923-58f909ca9cf4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895" status: 404 len: 111 microversion: 2.1 time: 0.029724 Jun 02 16:50:56.901591 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1395/2548] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:50:56 2022] GET /compute/v2.1/servers/35830839-10c0-4e8e-ba3e-a161a11c6895 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:50:58.192429 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:58.192968 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:58.199462 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:58.199908 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:58.200685 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:58.201118 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:58.214790 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f HTTP/1.1 Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:50:58.216305 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.217578 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': '20b7400e-e5fc-4ff4-a448-9922a5d2855f'} Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:50:58.218329 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.219587 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.221196 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 404 to user: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:50:58.221196 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-45802aa1-9ded-4991-9304-83686e201163 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 404 len: 111 microversion: 2.1 time: 0.029696 Jun 02 16:50:58.221196 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1154/2549] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:50:58 2022] DELETE /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:50:58.226260 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:58.226876 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: 20b7400e-e5fc-4ff4-a448-9922a5d2855f] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:58.233269 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:58.233728 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:58.234524 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:58.234964 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:58.250266 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f HTTP/1.1 Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:50:58.251773 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.253146 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': '20b7400e-e5fc-4ff4-a448-9922a5d2855f'} Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:50:58.253949 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. Jun 02 16:50:58.259320 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:58.260606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 404 to user: Instance 20b7400e-e5fc-4ff4-a448-9922a5d2855f could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:50:58.260606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-91e12eba-e859-4f70-b7b6-0db207ee3364 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f" status: 404 len: 111 microversion: 2.1 time: 0.031040 Jun 02 16:50:58.260606 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1396/2550] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:50:58 2022] GET /compute/v2.1/servers/20b7400e-e5fc-4ff4-a448-9922a5d2855f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 16:50:59.473323 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:59.473859 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.compute.api [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118257) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:59.480728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:59.480728 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:59.481384 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:59.481815 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG oslo_concurrency.lockutils [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:59.495003 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.wsgi [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: request: DELETE /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 HTTP/1.1 Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept: application/json Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Accept-Encoding: identity Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Connection: close Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Length: 0 Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Content-Type: application/json Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Host: 10.222.0.59 Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Openstack-System-Scope: None Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: User-Agent: python-urllib3/1.26.9 Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Id: None Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Domain-Name: None Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Identity-Status: Confirmed Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Is-Admin-Project: True Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Id: default Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Domain-Name: Default Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Role: member,reader Jun 02 16:50:59.496520 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Roles: member,reader Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Id: default Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Domain-Name: Default Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: method: > Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: exception: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.497625 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: action_args: {'id': 'a3494b94-2b58-405b-8dfe-ddcbf9083330'} Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: {{(pid=118257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:50:59.498265 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.499786 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.500973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: DEBUG nova.api.openstack.wsgi [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 404 to user: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. {{(pid=118257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:50:59.500973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO nova.api.openstack.requestlog [None req-293a4106-e99d-4af7-8b52-c2b07d6b4cb4 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 404 len: 111 microversion: 2.1 time: 0.028390 Jun 02 16:50:59.500973 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: [pid: 118257|app: 0|req: 1155/2551] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jun 2 16:50:59 2022] DELETE /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:50:59.507299 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Calling method '>' {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 16:50:59.507914 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.compute.api [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] [instance: a3494b94-2b58-405b-8dfe-ddcbf9083330] Fetching instance by UUID {{(pid=118256) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 16:50:59.514411 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:59.514858 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:59.515614 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 16:50:59.516049 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG oslo_concurrency.lockutils [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Lock "3dabfd63-010b-4913-be80-9c36dccab098" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 16:50:59.529922 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.wsgi [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] HTTP exception thrown: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Request method failure captured: Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: request: GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 HTTP/1.1 Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept: application/json Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Accept-Encoding: identity Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Connection: close Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Length: 0 Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Content-Type: application/json Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Host: 10.222.0.59 Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Openstack-System-Scope: None Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: User-Agent: python-urllib3/1.26.9 Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Auth-Token: gAAAAABimOZ0UikQfZXxt3VO3r6C-xOpdJsIdai2syRpJHK90a7CAqriJh7EmOukmB6TYEX3E_g-jlNaFn5AhqIUr9oPPVDhl4r-7XpN-sPxo0XSsdgBozs91wQenwEmCpph1073sVJmSj6pu8ohNdCjT_aIGKRCjZAKDU4UTR-CrOq4CZoVUl8 Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Id: None Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Domain-Name: None Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Identity-Status: Confirmed Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Is-Admin-Project: True Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Id: default Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Domain-Name: Default Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Project-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Role: member,reader Jun 02 16:50:59.531471 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Roles: member,reader Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/17568d6be8f640359bd4c6ec666ea168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/17568d6be8f640359bd4c6ec666ea168"}]}] Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Id: 17568d6be8f640359bd4c6ec666ea168 Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-549953235 Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Id: default Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Domain-Name: Default Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Id: f8503989cb4a4d9c8db260b403e07226 Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: X-User-Name: tempest-AttachVolumeNegativeTest-549953235-project Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: method: > Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: exception: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.532718 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: action_args: {'id': 'a3494b94-2b58-405b-8dfe-ddcbf9083330'} Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: {{(pid=118256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 16:50:59.533445 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. Jun 02 16:50:59.534832 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: ERROR nova.api.openstack.wsgi Jun 02 16:50:59.535979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: DEBUG nova.api.openstack.wsgi [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] Returning 404 to user: Instance a3494b94-2b58-405b-8dfe-ddcbf9083330 could not be found. {{(pid=118256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 16:50:59.535979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO nova.api.openstack.requestlog [None req-659a3418-6a8c-4df9-bb82-af4e90331686 tempest-AttachVolumeNegativeTest-549953235 tempest-AttachVolumeNegativeTest-549953235-project] 10.222.0.59 "GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330" status: 404 len: 111 microversion: 2.1 time: 0.030293 Jun 02 16:50:59.535979 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: [pid: 118256|app: 0|req: 1397/2552] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jun 2 16:50:59 2022] GET /compute/v2.1/servers/a3494b94-2b58-405b-8dfe-ddcbf9083330 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 16:51:40.138639 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:51:40.139197 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:53:10.952491 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:53:10.953089 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:53:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:53:12.432359 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:53:12.433022 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:53:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:53:26.222379 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:53:26.222885 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:53:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:53:26.526881 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:53:26.527076 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:53:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:53:39.627068 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:53:39.628032 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:55:00.147245 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:55:00.147818 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:56:30.961474 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:56:30.962110 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:56:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:56:32.440216 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:56:32.440890 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:56:46.231013 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:56:46.231471 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:56:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:56:46.535379 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:56:46.535560 dv-cinder-797608-27-iscsi devstack@n-api.service[118257]: Thu Jun 2 16:56:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 16:56:59.636063 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 16:56:59.636721 dv-cinder-797608-27-iscsi devstack@n-api.service[118256]: Thu Jun 2 16:56:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!